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FOREWORD 



The exislenre of main job titsk anal>sis methods and task inventories is Kenero!i\ not known 
lx»\nnd their immediate oriuins. This situation leads to needless duplication of elfort in developuiu 
and usinft them. 

To promote the interchanue of information about task analyses and task mvenlories, a National 
S\mposium on Task AnaUses Inventories was sponsored by the Task Inventor} Exch.tnRe (TIK) pro- 
jeri at The Cen*er for Vocational Education, One-hundred and fifty-eight persons rtpresenlinu the 
industrial. militar\ . business, uovemmental, and educational communities in 26 stales, the District of 
Ctilumbia. and Canada showed their interest in the task analyses inventories field b\ attendinR that 
s\mpnsium. The\ shared their experiences, problems, solutions, and thinking on this important field. 

\\c vMsh to thank the participants for attending the s\mposium and extend special appreciation 
to the spiMkers Un pnAidinu th^ stimulatinji and informative presentations. The followinu Center 
stalt are n^cnuni/ed for their efforts to coordinate the symposium- Paul Sc!,roeder, project director: 
Sunita Saldanha. s^n ret^irN .Willie Thomas, graduate resemh associate, and Ernie Wallerslein. student 
asMst.mt 

\\»* ho|M- this j>ubliratinn and the ser\-Kes of TIE will prove valuable in \nur endeavors. 



Robert E. Taylor, Director 

The Center for Voealitmal Educatifin 
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INTRODUCTION 



On November 17 and 18, 1975, a Rroup of 158 persons met in Columbus, Ohio, at the invitation 
it{ (he Task Invenlorv Hxthange, to discuss the processes and techniques of job task analysis and the 
use of task inventories. 

There were two primary* and closel> related reasons for conducting the symposium. First, the 
many diverse organizations and persons using task analyses and task inventories for training and per- 
ftjrmance evaluation should be aware of each other. Second, the information, that is techniques, 
accomplishments, etc., they possess should be sha.ed. The symposium was, therefore, perceived as 
a heginnmg to what is hoped will be a continuing and expanding forum for personal interactions and 
the intt^n hange of ideas. 

The papers in the Proceedings are reproduced as prepared b> their authors. Two speakers did not 
prepare papers. Therefore, only referent -^s to papers previously published by these speakers are pro- 

The Proceedings is our means of sharing th» fuH text of prepared papers with symposium partici- 
;^#ants. Also, it is our means of communicating with the people, interested in task anaissis insentories, 
who were u:iab!e to attend the symposium. 
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FORMATS AND STRATEGIES IN INFORMATION TASKS 



Rubert B. Miller 
Robert B. Miller, Services 



Task Information Archives 

A valuable endeavor with great potential si^ificance for personnel sybsystem design, especially 
if the library is also a repositor>* of developments in the various techniques and applications of 
task an&ly^s. 

Retrieval of Task Information 

The purpose of storage is retrieval. Retrieval efficiency and effectiveness depend on selective 
access to stored content according to purpose of the moment. Subject matter classification 
structure is the key to selective retrieval, but is must be shared by the operations that classify 
documents entering the files and the operations for retrieval from the files. Search costs and 
effectiveness will determine whether the archives are alive or dead. 

Classification Systems 

Taxonomic structure applied to content in the archives should derive from the purposes that 
users are expected to have for inquiring into the files. The terms in the clasufication should 
ideally link the full range of applicable archival content to the user purpose by means of efficient 
query structure. 

Manual search of several hundred documents to f^ubject matter query is feasible, but when the 
file includes thcfusands of lengthy documents, some form of subject and topic assess via indexing 
becomes imperative. The following are examples of purposes to which existing task information 
could be of practical utility. 

Design of training customized to requirements of Task X 

Design of training to the psychologicaMearning characteristics of Task X type 

Adapt the training package from "similar" tasks already trained 

Project performance limits, human errors from Task X to Task X'. 

Transfer human factors knowledge acquired about Task X to Task X*. ^ 

Estimate transfer capability of man trained in Task X to Task X'. 

Transfer selection data acquired on Task X to Task X\ 

(Note: Task X may be a laboratory research task!) 

Assess potential range of effect from an innovation in training, or a change in task pro- 
cedure, environment, etc. 
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Differentiate virtuoso task performance from perfunctory task performance within the 
characterization of task ''requiremenU." 

Develop performance criteria for evaluation of Task X' from Task X descriptions. 

Most of these questions boil down to the following: What training technology found applicable 
to tasks in the archives is relevant to the task at hand? What performance capabilities and errors 
to expect in a given task configuration? What aptitudes are relevant? What skills will transfer 
from one task context to another? 

Archives should be useful for the transfer of knowledge and findings from prevtous situatioiw to 
new situations. The trick is determining which of the old situations and findings are relevant to 
the one at hand where one wanU to design training or task support or aptitudes and to make per- 
formance predictions? 

A few of us have believed that whatever a *'task taxonomy" (ugh!) should do, it ought at least 
serve practical functions like this rather than academic "structures of performance." Since many 
purposes are to be served, it is likely that there will be several useful classifkation structures, each 
of which representt a model of the major variables and alternatives in a conceptual model of the 
context, e.g., training, selection, hunun factors design, etc. 



A Schematic of Descriptive Variables 

Lacking a more analytic and generalizable behavioral model of tasks, the following may serve as 
external descriptive rubrics: 

Equipment and objects used: tools used, these establish resource relevance to the task and 
competence in specified resource capabilities. 

Environments: the nature of the stress; contingencies; constraints. 

Reference informatio n: essential to, say 9(n of all Usk situations, f he reference informa- 
tion may be in the operator *s head, or he may have to find it and use it, possibly translate 
it into task operations. 

Task operations: performance models, procedures, strategies, handling of concurrencies. 
Also, scan-detect; identify; interpret, decide; construct; motor action; short term memory 
retentions. 

Criteria of performance: explicit or implicit; lower limits; enabling interactive tradeoffs 
among criteria, or independent criteria. 



Task Formats 

A concept enabling a basis for generdizing within a format class with respect to training prin- 
ciples applicable, and expectations of transfer of training. 

Applicable to perceptual, perceptual-motor, cognitive activities. Example: Quickness in trans- 
ferrmg driver skills from U,S. to Britain in spite of reversals in location of clutch, position of 
driver, side of road, passing and corner turning patterns. 
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Format defined : The constants that persist from one task cycle to mother. The '*constaats" 
are the set of variables relevant to the task situation that characterize (a) the task or service 
requirement: (b) task reference information ;(c) response repertoire. 

'^FDrmat is the organizer (or the orf^anization) of information context in short term memory. 
A classical example of format yielded by a trans?ction structure : 

a. A requisition form requesting a set of want( i objects: the format is contained on a printed 
requisition *'format of variables.** 

A reference file of vendors, objects vended and other attributes (variables) relevant to se- 
lecting a vendor: a standard format of reference information in the structure of a table of 
entries, where each item in a list of entities (vendors) has a set of attributes and attribute 
values associated with it. 

V An order form for creating an order to a vendor: a standard format of output variables in 

the transaction 

d The processing by the buyer in performing the task of translating a requisition to a purchase 
order consists in applying policy rules and making mental tradeoffs between request var- 
iables (demand) and service variables (resources). 

Note that '^format** emphasizes the classes (variables) of information (input, reference and out- 
put) to be processed as a context, or to be processed in context sequences, and somewhat de- 
emphasizes the importance of specific processing operatbns or rules. In general, the latter can 
be quickly learned or modified as cnnstrasted with the learning to cope (hold in mind) daU con- 
texts« 

*Since task format is central to organizing informa^'on in short term memory ; it is one central 
factor in generalizations about training; transfer of training range; subsetting and organizing psy- 
chological knowledge and principles. 

"^A by-product of the concept of task format and transaction format: 

Intelhgent design of data base content and organization to support human tasks by information 

systems. 

Comment. Don*t leave data base application design to programmers— it will result in the same 
mess as info retrieval left to librarians and education left to scholastics. None of 
these use task reference for system design! 

Some Format Types Examined 

a. Human control of complex operations: briefing, exception detection, diagnosis, correction 
of deviation by either reallocation of resource, rerouting of action, or modifying the goal of 
the work cycle: all of these involving standard task variables to that controller's authority 
and responsibility. 

b. Human Diagnosis-a series of symptom tests leading to a hypothesis that identifies the 
correctible cause or the choice of a remedial action. 
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c. Human decision-making-semi-quantitative and qualitative (see the example cited under 
'Tonnat defined" in a preceding topic). 

d System evaluation ( what are the system outputs under var>'ing ranges cf system inputs and 
environments) and system optimization (imp roving efficiency and cosU by redesigning path- 
wa>s, functional nodes and distribution of the system's resources and objectives). 

e. Diiscovery- bn>wsing and hypothesis formation; hypothesis testing and relevant range de- 
termination, application. 

f. D^gn and construction (includmg planning) application of rules and constraints in com- 
bmmg from within resource constraints^, a build or action specification intended to serve one 

or more purposes 

Task Strategies 

Th&s is the niuans in^edient in ta:>k studies and training. 
Quer\ What variables in the job b the operator trying to optimize? 
Examples 

Spat e vs inne 

Speed vs dccurac> « 

Risk-ukmg V2i ^ecurits 

Efficiency vs flexibihtv 

Short term «am lung ivxm ,»ain 

Etc. 

Strateg> defint'd 

Policies for making ""uuod*" tr,idt'cffs amonu rompeting variables; 

Policies fur uptimi/mg rebourtes fi^r demands, and demands for resources; 

According to ^iven outcome crilt^ria, making best use of resource capabilities in an uncertain en- 
vironment. 

Strategy' examples 

Driving mimmuinji rhan^es in veloeil\ and direction 

Typing st^paratmu rate of input from rate of output buffering between input and output. 

Diagnosis choosinn each next test that maximizes the amount of diagnostic information likely 
to be provided bv the test outcome. 

Design from general conceptual layout to sptvifics, where the hierarchical structure helps de- 
signer keep in mmd what he is doin^ and trying to do. 

Filing balanc in« the effort ust^d in putting .•lomething away against the effort likely to be spent 
in retrieving it 
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Any job: dttermiainf criteria of effectiveness (and tolerance limits) in order to establish what 
actions and infqrmation are relevant as opposed to those that are irrelevant. 



Conclusion 

Useful and excitinf work is still ahead in getting briber practical insighU into task formaU 
and task strategies for comprehending human tasks beyond the robot level of description and 
analysis. A pragmatic way needs pointing to higher level of human competence u possibilities 
and hopefully u realizations. 
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TASK AND CONTKNT ANALYSIS METHODS- AN EXPANDING VIEW 



Andrew S. Gibbons 
Courseware, Inc. 



I would like to outline today my views on the field of analysis as I think it exists now. While 
completing; a review of task and content analysis methods, I found a variety of--at last count--28 
different methods which are being used prior to instrucUonal design to aniJyze instructional tasks 
and bodies of content into instructionally manageable and signifkant units. Some of these methods 
were used commercially in private contracting businesses, some of them in military agencies, and some 
in educational agencies, schools, and colleges. Td like to outline some of the things that I found as I 
did this review and then state what I feel the implications are. I won't get into the deteik of any spe- 
cific method, but that information is contained in the full version of my paper. 

I would like to frame my remarks toward a question which is to be developed later in this con- 
ference: *'Do we need the Task Inventory Exchange?** Dr. Miller sounded this note in his talk, and 
I believe it is one of the motivating factors for this meeting to find out what kind of service the TIE 
can render Tm not personalty connected with the TIE, but I'm very gl«d to lee organizations of this 
kind that are interested in becoming centers of communication and dissemination for the field of 
analysis. 

I would like to make three points in my talk. The first point is that analysis, as a stage of the in- 
structional development process, is probably the most important-one of the first and certainly the 
most far-reaching in its effects on other stages. Second of all, I would like to state that a diversity of 
analysis techniques now exists and that each is suited to a particular purpOK. Just as every carpenter 
has a bag of tools, I think that instructional developers have a bag of toots for analytift, and not all of 
them have the same function. The third thing that I would like to say is that a categorization of these 
techniques is possible and that it s probably going to be important to further work in development 
techniques and may even give us major conceptual tools [or dealing with all of the development pro- 
cess in ways we now do not. Let me treat each of my three points separately now. 



The first point is that the analysis stage in instructional development process is probably the most 
important. When we were all college students, the professor drew Bob Glaser's four-box diagram of 
the Instructional Development process on the board. We have seen different variations on that theme, 
but all have in common as a first step that you define the objectives or the goals of the system. You 
define systematically what you have set out to do so that you can tell when you are finished whether 
you did it acceptably. There are various other processes that follow defining of objectives in the 
various diagrams of the development process, but that one always seems to be present and right at the 
first, and Analysis is the process by which we arrive at those objectives. 

The first -in iine position of this process coupled with the fact that the product of the analysis be- 
comes an integral part of everything that followr-becomes the main ^language" of further work- 
makes it apparent that a very important product comes out of analysis. If a developer doesn't know 
how to select media, it might be expensive but it probably won't influence the developed product ad- 
versely if the methods used are sound. If a developer doesn't know how to use instructional strategies 
to build a behavior, then the student can be counted on, as he has in the past, to either detect the criti- 
cal elements to be learned or learn everything and save the program. But if a man doesn't do a good 
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analysis, then there begin to appear adverse economic, efficiency, prucram consistency and student 
interest factors that can add up to failure. A good analysis is a criticalh important thing. 

Because analysis is important to the development process, the development of the field of analy- 
sis iteself is important, I believe that we are jusi stepping out of the Wright Brothers era with analytis 
techniques. I'm thrilled by Dr. Miller's remark that this is the time for invention in task analysis and 
development and not yet a time for full dress scientific examinations. I think that we ought to looaen 
our ties and put our ftet up on the desk and armchair a little bit, everyone together. We're emerging 
from an era, 1 belive, where every developer had to reinvent the wheel everytime he did an analysis. 
Groups Tike this one we are met in t ^ay are directing attention to the details of carrying out and 
using analysis Soon people who have compared notes on what they do will be able to invent more 
stable and useful processes than they could when they work atone. And as these people sUrt talking 
together, they will bring up new issues, and ts these issues begin to solidify, there will be a direction 
formed around which research may coalesce if it is needed. 1 reaily think that this is critically im- 
porUnt, and don't think that in the past it's been done like it should be. That is why I say that we are 
just stepping out of the Wright Brothers stages. We are each coming out of the ''parage" and every- 
one is starting to talk together. 

I feel that coming out of the "gar^e" is imporUnt because my pe»onaI interest extends beyond 
task and content analysis. I feel that naming effective strategies, making appropriate selections of 
media, and using effkient yet effective course design and production methods all hinge on the produc* 
of analysis. It is a tremendously important thing, yet it is not what we have concerned ourselves with 
most directly as instructional developers. Let me read you a quote which highlights this misdirection 
of attention. 

"Studies of teaching have been carried on as though the phenomentm of U'ai hing were 
v^eil understood. For example, there have been investigations of the attitude of teachers 
toward their students, studies of permissive and authoritative behavior of teachers afM ihe 
effects of such behavior, studies of the intelligence of teachers and their knowledge of the 
subject matter, and inquiries ii.to their personality traits The failure of such studies to 
yield a body of consistent knowledge about instruction indicates that perhaps they were 
premature; that more direct or primative analyses of teachmg behavior are needed as a 
preface to experimental or correlational studies. Furthermore, such factors as personality 
trails, intelligence and knowledge of instructional content are sUtic elements of teaching 
behavior indicating nothing about the operations involved in teaching, that is, how con- 
cepts, norms, laws, etc. are introduced, analyzed, and manipulated in the course of instruc- 
tion." (B.O, Smith, M.0« Meux, A Study of the Logic uf Teachmg. W of Illinois Press, 
Urbana. 1970, pg. 1-2). 

Smith IS saying that we have danced around the periphery of the real question The real question 
IS the interchange of information and attitudes that make up the act of insuuriion, th^* moves, the 
maneuvers, the sequence, not the devices. But that question, to be ars>*ercd svsU»mutically, is linked 
to the sutement of instru'^tional intents and the logical prcifes&es for deri\inu iht- 'n. This is the kind 
of redirecUon of attention that instructional developers are ^uinu to have Ui m hitve In^fore they can 
start applying their trade, and il begms as a question of dnal>sis. 

I believe that there are some benefits to be derived from paying direti ;iltt ntion to the analysis 
process and from developing more sophisticated tools for anah sis. I ^^ould like to li^t some. These 
will be only instructional developer concerns; remember that when l>r Miller talks about task analy- 
sis he talks about it as a part of an entire personnel sub-s\slem i)f whuh trammu is onlv a relatively 
minor part Here are the benefits I see. First, conimun^' ations ^ibout the subjffc i matter during de- 
sign IS faciIilaU»d if a language has been fornief! i bar at ten/m^ thf elfintnis of mnwnt. Not only does 
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iommunuation pmcwd more efficiently between members of the design and production groups, but 
netiotiatioas with i lienLs become more structured as it is possible to name more specifically some of 
the characlerkstics of the finished product in terms of content and behavior. Second, it is probable 
that a languaco to communicate the properties of content will make the development process itself 
more efficient and less costly Third, once a languaKe of content and structure b created, the discus- 
sion of mstructional strategies and the manipulation of materials to reflect various strategy plans will 
become a better controlled process. Four, the design of tests and evaluation schemes may be assisted 
when a careful anal\sis Is made of the elemenU of content. Often the determination of content ele- 
ments IN based upon some theoretical or research premise. Implied by these premises is the method 
for evaluating: master\ of the content. The task he used in evaluating during research also serves as a 
task for testing masier> . Also, because most methods of analysis cttegorieze only a few types of be- 
havmr the prcnluclitm of objectives is faciliuted in the same way that tK* production of evaluation 
Items Ls facilitated Fifth, if units of instructional content can be named and related, then the com- 
parison of instructional pn>grams on the baMs of content or skills mastered becomes feasible. Sixth, 
given a stable method of analysis, the assignment of instructional strategies may become more a tech- 
nology and lev> a subjective procf«. Have you even been in the situation where you had all the resul^^ 
of a task an J^is and it was your jobTo turn that into instruction somehow? What did you do? You 
probabh found that the science" which had brought you that point left you with little to go on 
with 

We realK don't knov^ how to talk about strategies, but taking the lead from your analysis, you 
might consider strate>!\ as a matrix for delivery for content items, and analysis can lead to a descrip- 
tion of those Items 

Mv second main point is that diverse analytic techniques exist, each suited to a particular applica- 
tion. /Vs I madf mv review I found there are a number of fields conveiging on the analysis question, 
surting to devise plaas and methoiis for analysis that have relevance to the instructional strategy and 
technique used bv a developer. I think that I could nante them under about four groups which are all 
attending to analysis-related problems. First of all, there is a group I would call the Education group. 
These people are concentrating directly on instructional and training problems and are using analysis 
as a tool to facilitate the building of learning sequences and the process of instnictk>nal design. These 
people use methods which had their genesis back in the military training effort of World War II. The 
task analysis is that Dr. Miller has described in his papers, the hierarchical analysts that Dr. Gagne has 
described in his papers and the variations of each are products of this group, as are more recently cer- 
tain versions of "information processing*' analysis, which attempts to define the mental activity of the 
learner as he perforpis a task. 

The second group that is converging on the analysis qucfstion k what I call the Psychology group, 
The\ are the poople who try to understand how you learn proae text or rules or Just about anything. 
From their efforts at developing a learning theory a natural by-product is a technique for representing 
the things to be learned in the currency of the theory , Scandura*s learning theory requires us to look 
at subject matters as collections of rules. Doing an analysis using this perspective involves identifying 
that set of rules which best represents the subejct matter. Workers in the area of prose learning charac- 
terize a b(^dy of information to be learned in terms of its structural and meaningful properties, and 
they have evolved systems for identifying units of structure and meaning. I believe that one of the end 
products of an\ learning theory would be a frame-work within which analysis could proceed. 

Still a third group attacking an analysis problem is the Artificial Intelligence Group, People like 
Mar\in Minsk\ , Herb Simon, and Allan Newell are the most visible rcpresenUtives of this group. In 
/\rtifu lal Intelligence, the need is to describe a problem to a machine. Additionally, if a machine is to 
acq.isre new "information" after it is turned on, someone must be able to describe to the machine 
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what a bu of mfom^ation Out of the solution^ pruposit'd to this problem U evolving i iMguagt of 
problem structure and mformation structure. One major sub group of the Artificial Intelligence group 
has concerned itself with computer assiiited irtstructiun systems. The SCHOLAR system is an example 
of a CAI system based on an analytic method which m turn is based on a model of memory. 

Finally, I think there is a group of people m private mdustry who are attacking analysis from the 
economics sUndpoint. I know that at Courseware w^ are very interested in pushing our mtthods 
toward improvement, and analysis is one area we give special attention to because of iu importanct. 
\ Unfortunately, some of what is done by private concerns is considered proprietary , so the good ideas 
of some bright men don't get out to the field and don't get discussed. 

rd like to talk about three analysis paradigms that are used. In my survey it became apparent 
that there are probably three main themes in analysis righfliow --three main logics-and a number of 
vanauons on them. First, there is the well-known task listing or the task hierarchy. If you art a Bob 
Gagne follower you start with the task at the top*and ask the question "What d^ a person haft to 
know to perform this usk?" Then you iterate the process (k>wn to the sludtnt s tntry letrri. Another 
version is the task listing. In this process you uke a task and decompose it into constitutnt ptitt- 
phases or stages. I belive this differs from Oagne s method in that it does not support any '*psychol- 
ogical" propeities exist in the list obtained. wh*.*reas a (lagne hierarchy is defined in terms of a psy- 
chological principle called "transfer."' 

A second m^or anal\sis approach has bei'n i oiled the information Processing analysis. To me 
this IS thV most excitmg. This analysis Kels the instructional developer inside of the task. He attempts 
to determine what mental process a student is at lualU performing as he performs. If any of you are 
academics, you know that Lauren Resnick and David Klar, are working on this at elementary learning 
leveU Paul Merrill has worked with it through his interest m CAL Dr. MilWr's work is very much in- 
volved with this paradigm, and when the perspective of tune is available, we may see that this is what 
he has been saying all along. VA Smith, v^ho is at Michigan State University right now, is doing some- 
thing which shows how this kind of analysis can be useful. Ed has devised a threei)hase analysis which 
he calls Cunu»nt AnaKas. Task Analysis, and Skills Analysis. In the last phase-Scills Analysis he is ac* 
tually attempting to flowchart mental pnn^^sses You can take, according to Ed's theory, tasks that 
. are ver\ similar and teach them in juxlaptisition in such a way that you are teaching not only specific 
surface content but a mental processinR skill also He is researching this and demonstrating how the 
first time you teach a ta^ with a given format it takes a certain amount of time but how acquisition 
of subsequent tasks of similar format t-kes levs and less time. Since the student is not taught the task 
format dirertl>, he has acquired a counitive straleuv b> induction. 

The third type of paradigm thai I see beinti sugjiested is the network. I mentioned the 
SCHOLAR CAI system whu h is an artificial iniellmence device which operates on a network of infor- 
mation to respond to a student. The idea is very young and a?.though the possibilities are great, the use 
of this paradigm has been confined to labor at(iries I have attempted with some success to apply net- 
works mvself and see hov^ network i>pe relations have been very useful in representing the properties 
of a subject-matter. The idea is inherent for instance in Dr. Glaser s notion during the heyday of pro- 
grammed instruction of making a matrix to relate t*ver> idea to be covered in instruction to every 
other idea to be covered That sysu»m has not persisted, but the logic underlying it is far from dead 
with the network-users. The question is. how does this matrix of relations serve me in presenting se- 
quences of structured content to the student the attention now being toviard the structures and less 
toward the notion of sequence as it v^as v^ith l)'ro^ra^lmed instruction. Networks also remind us of 
Ausubel's oruani/ers, and there is hk* 1> tu hv in ihv future much more use of his ideas as techniques 
procresi*^ 
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Thv final nui.n p(»int that I wanted to make was that a cateRorizatton of analysis techniques is 
posslbIt^ and t b ut r < att*uiin/ation is Koing to be essential to directine work in tht area of analysis. 
To me this is a c ritu al ptiint. To long weVe said "We jiavetask analysis, what else do we need? (and 
remembt*r that v^htMi iwf) ili*u*loperssay **task analysis" !hey probably mean different thinKS). My 
answer is thnt 1 1 hink thai we need a Rood variety of techniques^ I think, for example, that we rah 
define thp.H* \^hxse> (»f anal\ sis which we ro throuRh as instructional developers for a single develop* 
ment prt»jiH t Yh.v fipvi is defining the scope of the expected behavior-a job or a body of content 
and then duidirm it intn major sub*areas of accomplishment^ tasks or main content area divisions. 

Thr M-i ond phast ! think begins when vi^ do a Learning RequiremenU Anal)^^, which it a phrase 
that B<»b (laim<- 1 <»»m*H In the learning requirements analysis you're not lo interested in the gross 
units of a job <ir h< >d\ <>l information or attitudes; you are interested in breaking things down in terms 
of tht* spenfir tt sstms \<>u will have to teach a student to lead him step-wise to the final behavior that 
\ou w ant him to Haw This pha.se of analysis may consist of the identification of a progremon of 
propositions nr nuMjt l>4»f infrH'mation, depending on what sort of learning you are tr>*ing to pro- 
mot 

Fm^lh v n rntt r ,x sugv of analvsis that determines the specific types of displays to which you 
will t xposi- thi stinirni in ih** rourse of instruction. That is, those displays or those elements which 
are eoin^! to mikr up \ ur instructional strateg>*. This analysis is related to and is a precursor to-but 
IS not the samp as drsijniinR strategies for instruction. 

I think that thoM» three phases of analysis are diKriminable in terms of having different process, 
different outputs, and different uses. Crossed with these phases, 1 believe it ver>* useful to defme a 
number of * domains * of learning, as they are described by Dr. Gagne, in which you might want in- 
strucuon to take plate ITiere are some times when you want lo teach a student how to perform e 
task, but therv an* sf)me times when what you want to teach him does not exist as a single, integrated 
terminal task or bf>d\ of normally-executed tasks. If you want to teach a claM in statistics within the 
constraints of a t fillege setting, you don't really want the guy ]u*<5t to perform an F-teit competently 
or you don't nally want him to just be able to do an analysis of variance. What you really want him 
to do IS to be skilled in making a lot of different technical and procedural deciskins. He's got to de- 
cide what one to use and then perform it. He is expected to perform taak*^ and to manipulate a certain 
bod\ of fac tual onceptual data. 

In anal\zine the tasks and information involved, you are likely to get good direction from more 
than one type of analysis In this case of statistics, for instance, you are likely to get good— but in> 
complete results from a task analysis alone. The resulu of a task analysts will direct you in the teach- 
ing of task skills, performing tesU, executing procedures, etc. The task analysis, however, will not give 
you verv good tof)is for dealing with the informational or conceptual dimenttons of statistk^s, the mo- 
dels of informauon \ ou will give to the students in sequence with the task instruction that hopefully 
will help him orgam/e his decision making in strange environments and his application of techniques 
to the appropriate problems. The exact source of help on this second analysis need is not clear, but 
It is clear to me from mv own experience that task analysis alone is not sufficient. 

Dr f iagne s dt»mains make it possible to separate these main areas of concern for analysis. He 
describes them ,is domains of learning, each requiring a different set of circumstances for instruction 
to take place Thev are Cognitive Strategies, Attitudes, Motor Skills, Intellectual Skills, and Verbal 
Information \s.suming that these domains can be crossed with the phases of analysis-which is done 
onl> to suggest possibilities- then some questions arise as to which analysis tool now existing you use 
for whii h purpose, and what purposes there are for which no analysis tool exists. What kind of anal- 
ysis do \ou p«Tf t rm. for instance, for determining the training requirements for attitudinal behaviors? 
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For idenufying the displays to be used in Motor Skills instruction? For analyzing the major coinpoii- 
ents of Verbal Information the student must master and be able to manipulate during ptrfoimancf? 
It turned out after my review when I had made this uble of analysis phaics and learning domains thai 
many spaces were nearly empty, while other^%ere quite crowded. This suggesud/o melhat ouf 
attenuon to the problem of analysis has been too narrowly confined. I suggest that sonne bcotfiU may 
be obtained by looking at the broader picture of anal>*sis not only from iim standpoint of organidng 
the work of analysis for those whose job it is to peifoim it, but also to direct our efforts toward thoM 
areas where a need exisu but has not been exploited. 

'^As a conclusion I would like to extrapolate to the future from the past. In about 193U Ralph ^ 
Tyler emphasized that instruction should be based on instructional ofafectives. Later Benjamin Bloorii 
agreed and added thiC he felt that all objectives were not unique and that some method of cUtgorita- 
tion should be pottibke, which he supplied. Then Gagne ^rted with that and. uang his own paitkukr 
categorization scheme, he demonstrated that an unbiased method of deriving obfectivtr-hitrarcliicai 
analysis-could be devised to guide the activities of the developer. Ptrhapt tiie next davtloprntnt in 
this sequence of evenU will be to recognize that different analytic tools can be applied succa<I^ JIy 
and usefully to different problems and that there were certain categories of obi#cti>as there «fe ■ 
certain categories of analyus, each useful to the devebper on specific types of analysis probltmi. 

To return Xo the question asked early in this paper-one of the main questions of this C0Qf«ir* 
encr *e need the TIE?" The answer must be "yes," Because of iu importance in the develop- 
ment process, analysis is one of the keys to improved technique and more effective products. Centtft 
bke the TIE should make it their business to open communication between interested parties on analy- 
sis matters. They should stimulate the development of needed analysis methodologies and encourage 
the comparison of existinu ones Tht rt'iurns i<> be had by the developer s profession from TIE*s play- 
ing such a role k more than enough to ]ustif\ its extsU'nce, and hopefulh the TIE*s activities in this 
direction can i*ro^. 



THK JOB ANALYSIS TFrHNIQl K OF THE LMTFD 
STATES KMPLO\^!ENT SERVICE 



Deborah Taylor 
Michigan Employrrifnt Security Ctin^mbftiun 



Iniroduclion to the Occupational Analysts Propram 

A. The United States Empbyment Service w«:» created by the Wafnev-Peyser Act of 1933. 
It pulled together the several sUte employment afencies that had been created since the 
befinninK of this centur>* and created afencies in states that had 9hi yet formed one. 

^ Local offices came into being all acroa the country to provide unemployment insurance 
benefits and employment opportunities to unemployed workers. It toon became af parent 
that there were communication problems between these offices when they talked to each 
other about jobs. This was a problem of national troportance because workers moved be- 
tween cities and even to ether parts of the country seeking work, bated on employment ser- 
vice recommendations. If these recommendations were based on confused information, it 
could do peat hardship to both the worker and the employer. 

C. Therefore, in 1935, The United Sutes Employment Service devebped W^mparabiltty LiH 
of Occupational Titles, which provided a list of sUndard titles for use by all local offices. 
This was still unsatisfactory, because the titles were not defined, so different kinds of work 
might still be identified by the same Aandard term. It wu finally deckled that a raewch 
program shouM be esublished to study jobs in our economy and provkle standard titles and 
definitions of them. 

1. The Occupatbnal Research Program of the United States Employment Service was 
initiated in the mkl 1930*s. An advisory program composed of indtvkluab with ex- 
perience in personnel and occupational research work were designated as the Technic 
cal Board for the Occupational Research Program of the United States Empbyment 

Service. 

2. A ''job anal\^ methodology** was devised and devebped in a series of instructk>nal 
manuals for internal uj» over ap^oximately a {en*year period. 

3 In 1939>4he first editbn of the Dicthncry of Occupational TitU$ was published. 

4. In 1944, a basic Training and Reference Manual for Job Analym was published. Th^ 
manual and iu revision in 1965 served as the guide for collecting and recording source 
data and applying the necessary job analysis techniques. 

The Handbook for Analyzmg Jbbt, published in 1972, is the current bible of our 
^ progr^im. 

5 The job analysis techniques developed in the early stages of the program were a pro- 
duct of the economic situatbn, that is, a surplus of qu; Jif ied workers and a shortage 

of jobs. 
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a) Data emphasized the ta&ks of a job (what, how, and why) and little emphasis 
was placed on the characteristics required of the worker. 

b) Only 3 itemr-<l) experience, (2) training, and (3) performance requirements 
(responsibilities; job knowledge; mental application; and dexterity and accuracy) 
on the Job Analysis Schedule referred to the qualif kations a worker must bring 
to the job. 

A drastic reversal in the economy by the 1940*s caused a scarcity of workers and a 
surplus of jobs needing to be filled. 

Employers in the 1940*s needed data on the char^^cteristics or traits which an appli- 
cant should possess in order to learn a job.. 

a) Entry or less-than-qualif led workers became important as a labor market resource 
-the system needed to evaluate jobs and worker's potential on th^ basis of per- 
sonal requirements. 

b) The Job Analysis schedule was^xpandei! to include (1) a form for recording the 
Physical Demands of jobs and (2) a Worker Characteristiacs Form for recording 
the ^'personal traits" required of the worker. 

c) In 1944, a first attempt to provide personal traits information was provided by 
Part IV of the first edition of the Dictionary of Occupational Titles, 

^i^lDocument was entitles ''Entry Occupational Classsiiication*' and wu de- 
veloped for use in counseling and placing entry workeis. Jobs were analyzed and 
described in terms of /sonal traits.** 

d) In 1949, two important things happened. (1 ) The second edition of the Diction- 
aty of Occupational Titles was published. (2) A project was initiated for the de- 
velopment of a new classification system for jobs that would reflect what the 
worker does and the requirements made on him. Several experts in counseling ^ * 
and work classification -^et to c|tegorize, define, and standardize traits required 

% of the worker. Manualizt techniques and instructions for determining Work Per- 
formed and Worker Traits requirements were devebped. This became known as 
the FunctkSnal Occupational Classifkation Project. 

e) In 1956, Estimates of Worker Traits Requirements for 4,000 Jobs as Defined in 
the D.O.T was published. Thjs document was a result of several years of research 
in attempting to characterize jobs in terms of important worker traits. I will 
speak about the worker traits in detail at a later time.- 

f ) During the research for the first and second editions of the Dictionary of Occupa- 
tional Titles fieM centers were set up in several states to collect the necessary 
data. After each edition, the field centers were disbanded In 1955, it was recog- 
nized not only that a third edition of the Dictionary of Oc^^upational Titles woxild 
be necessary, but also that occupational change was constant, j>o it was deter- 
mined that field centers shoufd be established on a permanent basis. By 1958, 
several field centers were established and beginning field research for'th.e t^ird 
edition, which was published in 1%5. Since 1963, research has been gomg on in 
prepauration for the fourth edition, which we expect to publish in 1976, as a part of 
the Bicentennial celebrations. 
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D. Where We Are Now In Terms of A National Program • field centers were set up in 1958. 



?. Currently there is a national office in Washington, ten Occupational Analysis Field 
Centers and one Special Project Center. I have prepared a list of the centers, their 
addresses, phont numbers and supervisors for you to keep. 

?. All field center efforts are focused now on the final review of the materials (job defi- 
nitions and worker traits ratings) for the 4th edition of the Dictionary of Occupational 
Titles. The main work is currently being done on a monthly or bi-monthly basis in 
Raleigh, North Carolina by selected field center analysts. 



II. A spei-i^»c method of job analyids in the employment service. * 

A. In the U.S. Employment Service, job analysis Is currently defined as that activity*which is 
involved with: 

1. Deierminins what a worker does in relationship to data, people, and things (worker 
functions). Item No. 5 on Job Analysis Schedule. 

2. Ascertaining what methodologies and techniques are involved in the work (work 
fields). Item No. 5 on Job Analysis Schedule. 

3. Defining the materials, products, subject matter, or services involved in the operations 
(MPSMS). Also in Vem No. 5.' 

4. Identifying the requirements made upon the worker (worker traits). Item No. 6 on 
Job Analysis Schedule. 

5. Specifying the machines, tools, equipment, and work aids used to achieve the work 
i)bjectives (MTEWA). Item No. 13 on the second page of the Job Analysis Schedule. 

B. In order to meet the requirements for a complete analysis of a "job/* the above mentioned 
categories of information must be obtained and recorded on the Job Analysis Schedule 
where I have indicated, and must be stated or implied in the job description. Let us '^^art 
first with worker functions. 

Ml 

1. WORKER FUNCTIONS 

a) All job-worker situations involve a relationship to data, people, and things to 
some degree. We express these relationships by 24 worker functions which are 
arranged in a hierarchythe lower the identifying number, the higher the level 
of worker involvement. 

b) The definitions for data, people, and things, and for their respective functional 

^ levels, can be found in Volume II of the D.O.T. or in the Job Analysis Handbook, 

both of which are listed in a bibliography available to you on the table. F«rst, 
we determine the level of worker involvement for each function. 

c) When a job requires a significant relationship to one of the functions for data, 
' people, and/or things, it is circled on the Job Analysis Schedule and will be re- 
flected as significant in code used for the Dictionary of Occupational Titles. 
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d) The worker functions r.ainus are reflcLted in the last three digits of the six digit 
code used for evur\ oti upalion listed in Iht? Dictionary of Occupational Titles, 
Third Edition. 

e) In order to determine whether <»r nut a luneliun ib significant, we consider the fol- 
lowing factors. 

( 1 ) The amount of time the function represents in the job - if it is present most 
of the lime, it is probably significant. 

(2) Whether the function is critical in the opinion of the employer. This is de- 
termined by asking the employer what function he is really paying for. In 
the case of a skilled machine operator, the employer is usually payirtg for 
the worker s ability to analyze or compile data from blueprints, etc. and for 
the worker's knowledi^e and ability to set up the machine. 

(3) The higher the level of the worker function, such as 0, 1, 2. or 3. the greater 
the likelihood that li will be Mgnificant. This may be true even if the fiinc- 
lion is pre>t»nt a small portion of the time. For example, setting-up is sig- 
nificant for the i>killed mat hine operator, even though be/she spends most of 
the time watching the machine run after setting it up. 

WORK FIKLD 

a) Specific work met hods Used in the execution of job tasks are referred to as work 
fiJds. Kach work field is characteristic of; 

( 1 ) The machines, tools, et|Uipmtnl, or work aids that are used to achieve a com- 
mon lechnolo^ncal ohjecfiNC. 

(2) Thosi» techniques I Ikat are ilesi-ned to fill a particular socioeconomic 
purposiv 

h) There are lUO v^orK Ileitis v^hit h appear in twenty-eight groupings, arranged on 
the basis of their siinilariiies in tei hnolouieal or socioeconomical objectives. 

c| They cover the acquiring of materials and the manufac ire of products or the pro- 
cessing of information or the providing of services. 

d ) The more general work tields ntv defined, whenever possible, in terms of the Am- 
pler ones which are related to them. For example. Structural Fabricating- 
Installing-Repairing Ls defined as a combination of work fields which includes 
Abrading, Nailing. Riveting. Welding, etc. 

e) Jobs are fri^^uentK observed which involve techniques that are covered by sc . ral 
work fields. In such instances, a work field is chosen that characterizes the pri- 
mary function of the job. However, a subsidiary work field may be listed. 

MATERIALS. PRODUCTS. SI Wl-X T MATrKR, /\ND SERVICES (MPSMS) 

a) MPSMS is found tiirertlv below the w<irk field area in Item 5 on the Job Analysis 
Schediile. The source ot entrus tor this component can be found in the MPSMS 
groupings in the Jah . \nal\sis Unndbook. 
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b) The MPSMS organization is a list of categories that are derived from commodi- 
ties groupings in the Standard Industrial Classification Manual and from Educa- 
tional Classifications of subject matter fields. 

c) There are approximately 580 categories, which are organized into 55 mi^or 
groupings. 

4. WORKER TRAITS - INCLUDES ALL OF ITEM NO. 6 ON THE JOB ANALYSIS 
SCHEDULE 

In any work situation, there are certain requirements made by the job upon the 
worker. These requirements are known collectively as worker traitSi and encom- 
pass the concepts known as training time, (GED & SVP), Aptitudes, Tempera- 
ments. Interest, Physical Demands, and Environmental Conditions. 

Let us look at each worker trait separately. 

a) TRAINING TIME is made up of two parts: (1) General Educational Develop- 
ment (GED) and (2) Specific Vocational Preparation (SVP). 

( 1 ) GED (General Educational Development) 

(a) Although GED is related to the amount of formal education received, 
it must jiQt be though of merely as the attainment of a certain number 
of ''years of schooling*' required to perform a particular job. The en- 
tire iife of-learning experience must be considered in the evaluation of 

GED. 

(b) Three fundamental skills are delineated in GED: 

(1) Reasoning, (2) Mathematics, and (3) Language expresaed as six 
levels of increasing complexity and difficulty with Number 1 being the 
least complex and Number 6 the most complex. It is powble to esti- 
mate what GED level is required for "average succeaful performance** 
on any job by comparison of the job being studM to pertinent bench- 
mark work situations which are found in the Job Analysis Handbook. 
Each of the three factors should be considered independently of the 
of the others in evaluating the level required for a job. 

(c) Reasoning development will be present to some degree, in all jobs. 
However, if a job involves computational work, for example, the mathe- 
matical development required to perform the job will be an important 
aspect along with reasoning. 

I (2) SV? (SPECIFIC VOCATIONAL PREPARATION) 

SVP is also discussed in the Handbook. 

(a) SVP is the total trtining and practice time it takes to arrive at average 

performance on a specific job. Usually, the more complex the job is, 
the longer that time will be. 
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(b) Items a through e of No. 8 Vocational Preparation, on the second 
page of the Job Analysis Schedule, details the different kinds of cir- 
cumstances under which the preparation may be acquired. The timo 
spent in General Education E)evelopment (GED) is not considered in 
estimating SVP. 

(c) You can see a definite progression in the amount of vocational prepaia- 
tion needed to arrive at average performance for any of the jobs, h is 
important to know that the ratings of SVP do not always parallel the 
ratings of GED for the same jobs. For example, a chef has an estimated 
GED level of a 4 but an SPV level of 9. 

b) APTITUDES - DISCUSSED IN THE HANDBOOK 

( 1 ) When we speak of aptitudes for our job analysis purposes, we are not refer- 
ring to the general aptitude potential that a person may possess, but to an 
estimate of the actual aptitude capacity present in a worker or required by a 
job. Worker trait aptitudes are "specific capacities and abilities required of 
an individual in order to learn or perform adequately a job task." 

(2) Please do not confuse this system with the aptitudes as potential abilities 
which are measured by the General Aptitude Test Battery (GATB). 

(3) The basis for our aptitude estimation is the estimated amount of aptitude 
that is required, from each of eleven factors, to perform a job. 



G ■ 


Intelligence: 


V ■ 


Verbal Aptitude: 


N ■ 


Numerical Aptitude: 


S ■ 


Spatial Aptitude: 


P 


Form Perception: 


Q ■ 


Clerical Perception: 


K - 


Motor Coordination: 


F • 


Finger Dexterity: 


M - 


Manual Dexterity: 


E • 


Eye-Hand-Foot Coordination: 


c . 


Color Discrimination. 







(4 ) We are Roing to think of aptitude levels as the abilities of fraction of the 
working population. 

Let's say 1/3 has low aptitudes, 1/3 has medium aptitudes, and 1/3 has high 
aptitudes. Now, let's cut off KTr of the whole population on one end and 
call that very low aptitude. We'll do the same thing on the opposite end and 
call it very high aptitude. Now we have five levels (roughly 10%, 23%, 33%, 
23%, and 10% of the working population). 

(5 ) For identification purposes, verv high aptitude requirement will be Number 
1, high aptitudes Number 2, medium aptitudes Number 3,iow aptitudes will 
be Number4 and the verv low aptitudes will be Number 5. This results in a 
bell curve distribution. Be aware that, in our program, an aptitude rating of 
D (the ver\' low level) usually means that the ability is not present in the job 
in any significant degree and therefore, not required. 

c) ^ TKMPERAMENTS - EXPLAINED AND ILLUSTRATED IN THE HANDBOOK 

( 1 ) Temperaments, as a component of worker traits, grew out of the belief held 
by many counselors and placement people that different jobs seem to call 
for different temperament traits. 
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Temperaments are the abilities to adjust to certain kinds of work situations. 
They differ from interests, which are positive preferences for certain kinds 
of wurk situations. One needn^t be interested in a kind of work to be able 

to tolerate it. 

(2) Job placement experience indicates that the 'Temperament'* of an appli- 
cant b often a determining factpr in success on a job-that a person's dis- 
satisfaction, failure to adjust, or lack of success may be attributed to a tem- 
perament factor. i 

(3) It is important to be able to recognize in jobs those situations that will im- 
pose themselves upon a worker's intrinsic nature and personality qualities. 
Ten such factors have beep identified as significant temperament qualities 
in job performance. 

d) INTERESTS ARE EXPLrJNED AND ILLUSTRATED IN THE HANDBOOK 

( 1 ) Interests are ^^preferences for certain types of work activities or experiences, 
with accompanying rejection of contrary types of activities or experiences." 
Interests are a significant component in occupational classification because: 

Numerous studies have indicated a significant conelation between job 
stability and satisfaction and positive interest in the type of work. 

(b) The chief investigators of interest indicate that interests are relatively 

stable subsequent to adolescence. 

(2) ' Our s\.stem is based on interest factor studies, especially those of William C. 

Cottle, which suggest that interest factors are Bipolar in nature, that is, a 
positive preference for a type of work is generally attociated with a dislike 
or rejection of a contrary type of work. 

(3) Interest experts believe that most jobs require characterization by at least 
two factors to express adequately the interest pattern of the work situation. 
Therefore, jobs have been rated by at least two interest factors, and some- 
times more in order to show an interest pattern-refer to the Job Analysis 
Schedule. For example, a job such as a Material Handler would be rated la - 
a preference for acti>ites dealing with things and objects and would probably 
not be rated for lb - a preference for activities concerned with the communi- 
cation of data. These two interests would normally be exclusive of one 
another. 

e) PHYSICAL DEMANDS FACTORS-TURN TO THE LAST PAGE OF THE 
JOB ANALYSIS SCHEDULE. THESE-FACTORS ARE EXPLAINED AND 
ILLUSTRATED IN THE HANDBOOK 

(!) During the Analysis of a job, it is first determined whether any of the 
physical demands factors are present. If a factor is present, we then deter- 
mine how much of the worker's time is involved in that factor. If the 
worker spends up to 1/3 of his time on a factor, an 0.for occasionally is en- 
tered on the form; if he spends from 1/3 to 2/3 of his time, an_F for fre- 
quently is entered; if he spends 2/3 or more of his time, a_C for constantly is 
entered. For example, if a worker spends 80% of his time reaching for and 
handling tools, we would then place a^for constantly in Item No. 4. 
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(2) In addition to detennining the amount of time the factor is present, we 
also determine whether that factor is critical to successful performance 
on the job. We make that judgment on the frequency of presence or the 
importance of the factor. If it is critical, we circle the factor on the bottom 
of the form and on p. 1 of the Job Analysis Schedule. 

(3) If factors require comments, they are annotated on the right hand side of 
the schedule. 

Obviously, physical demands are very important in reflecting the total re- 
quirements of a job. A careful and thorough analysis of these physical de- 
mands is essential for those people using th information for job counseling, 
placement, and devising training programs, especially for handicapped per- 
sons. 

f ) ENVIRONMENTAL CONDITIONS OR WORKING CONDITIONS-THE LAST 
WORKER TRAIT COMPONENT, REFLECTED ON THE LAST PAGE OF THE 
JOB ANALYSIS SCHEDULE AND EXPLAINED IN THE HANDBOOK 

(1) Here again each factor is noted for being nqt present or if present in the job* 
whether it is occasionally, frequently, or constantly. Again, we determine 

if a factor is critical to successful performance and circle the factors at the 
bottom and on the front. 

(2) Protective clothing and personal devices the worker wears/uses are also 
noted. This concludes our discussion of worker traits. 

5. The last major kind of information to be collected relates to the machines, tools, 
equipment, and work aids used to achieve the work objectives. Turn to Item No. 13 
on p. 2 of the Job Analysis Schedule. ' 

a) Each component is listed separately— that is, all machines together, etc. It is ex- 
tremely imporUnt that these items be identified as it may be crucial to the job 
duties and requirements that a worker be able to operate various machines, pieces 
of equipment, etc. A complete definition of each of these components may be 
found in the Handbook. 

6. We have completed a brief discussion of the 5 categories of information which must be 
obtained for a complete analysis of a ''job,** as defined by the U.S. Employment 
Service. They are: 1 - Worker Functions, 2 - Work Fields, 3 - MPSMS, 4 - Worker 
Traits, and 5 • MTEWA. Besides rating the jobs we study for these kinds of informa- 
tion, we use this information when writing a detailed description of each job, to in- 
sure that our job descriptions treat all important characteristics of the work. 

TASK DESCRIPTIONS-Item No. 15 on the 3rd pa^e of the Job Analysis Schedule. 

1. We have our own method of presenting and writing tasks for job definitions. Our 
technique permits the most complex job-worker situation to be stated in brief de- 
clarative sentences. 
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a) The usual organization of our sentences includes: An implied subject, a verb, 
its object, a modifying infinitive and its object. , 

b) The subject is always the worker. It is always understood and is not included 

in the sentcAce. 

c) An action verb usually begins the sentence. This verb indicates the actions the 
worker is taking. 

d) The second part of the sentence is the object of the action verb. 

( 1 ) If the worker is involved with data, the object of the verb will be informa- 
tion in some form. 

(2) If the involvement Is with people, the object will be people to whom a ser- 
vice is usually being rendered. 

(3) If the worker is involved with thinfp, the object will be a machine, tool, 
equipment, or work aid through which the action of the verb is dischaifed. 

e) The action verb and its object is usually then followed by an infinitive which indi 
cates the object or purpose of the worker's action. 

f ) An object of the infinitive which is usually some form of material, product, sub- 
ject matter, or service. 

g) Tasks are separated, numbered and followed with an estimate of the percentage 
of time spent by the worker on each and recorded in Item No. 15 of the Job 
Analysis Schedule. 

2. Preparation for publication in the D.O.T.— one of the main products of our research is the 

Dictionary of OccupatiQnal Titles. 

To prepare our material for this publication the Job Analysis Schedules are combined and 
prepared in a new format as an occupation definition. 

III. USES OF JOB ANALYSIS AND THE SERVICES WE PROVIDE 

A. Som.e of the uses of job analysis as developed by the U.S. Employment Service are: 

1. Recruitment and Placement 

Providing meaningful and correct job data for the recruitment and selection of 
workers. t 

2. Better Utilization of Workers 

a) Establishing job relationships that can be used to transfer and promote workers 
in order to develop job opportunities at the entry level. 

r 

b) Delineating the physical demands of jobs, and suggesting job adjustments that 
will facilitate the use of handicapped workers and other special interest groups. 
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3. Job Restructuring 

a) Accommodating new work processes within an establishment. 

b) Making better use of the available work force. 

c) Assisting in the creation of entry job opportunities for the less-thtn-fully 
qualified. 

d) Facilitating the placement of workers in hard-to-fill jobs. 

e) Designing new positions for trainees. 

4. Vocational Counseling 

Furnishing the vocational counselor with a guideline for vocational counielinK by 
pre:»enting accurate descriptions of the Usksand requiremenU of jobs, and ^ne Uain- 
ing« experiences, or avocations that lead to them. 

5. Training 

Determining training needs and developing training programs, especially on-the-job 
training programs. 

The cont4;nt of the training curriculum, time required for training, and selection 
of trainees are dependent, in part, upon thorough knowledge of jobs. 

6. Pcrforniante Evaluation 

Providing an objective basis fur developing performance standards. 

7. Plant Safety 

Improving plant safety by dLsclubing job hazards. 

8. Job Evaluation 

Providing an objective basis from which to develop job evaluation standards. 

The documents on our table represent some national efforts-3rd Edition Dictionary of 
Occupational Titles, Volumes I and II, job restructuring pamphlet, etc. In addition, I 
have included a sample indust/y study which includes staffing schedules, job analysis 
schedules, job definitions, flow and organization charts, and a narrative report. Also, the 
Bureau of Hearings and Appeals, Social Security Administration, requested that our center 
study low training time and light physical demands occupations f6r use the adjudication of 
disability claims cases. A copy of one of these studies is available for your review. Please 
do not permanently remove any of these materials from the table. 

In addition, there are copies of the following materials which you may keep: 

1. A list c the services and types of information we provide. 
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2. A bibliography of some pertinent documents published by the 
..Department of Labor, Manpower Administration. The prices and 

address to contact are listed on the bibliofraphy. 

3. The names* addrrjws, and phone numbers of the Occupational 
Analysts Field Centers, Special Protects, and the National Office 
in Washington. Feel free to contact any of these centers if you 
have questions or problems and you believe they may be of as- 
sistance in resolving them. 

We, in Michigan, may be contacted for formal job analysis training ses- 
«ons. Hiese sessions usually cover the main areas of the entire job 
analysis program, including how to conduct an industry study, how to 
prepare a staffing schedule, a complete job analysis schedule, and a 
nanrative report. Negotiations for this training may be made with us. It 
is free of charge and is scheduled acconling to our center work-load- 
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FUNCTIONAL JOB ANALYSIS 
Sidney A Fine 

Sidney A Fine Associates, Inc. . ^ 

F!ne,Sidney A., Ann M.Holt, and MtrclF. Hutchinson. FunctionalJob Ana!y$i$, An Annotated 
Bibliography. Methods for Manpower Analysis; No, 10. Kalamatoo: W. E. Upjohn Institute 
for Employment Research, 1975. (75 cenU; 300 South Westnedfe Ave., Kalaknazoo, MI 49007). 

This document will refer the reader to 83 publications which provide a chronolc^cal survey of 
the development, growth, and application of the functional job analysb concept from 1951 to the 
present. 
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THE COMPREHENSIVE OCCUPATIOI^J^ DATA ANALYSIS PROGRAM (CODAP) 

Raymohd E. ChrisUl 

Uniteid States Air Force Occupational Retearch Division 

Christal. Raymond E. Tht United StoUt Air Force Occupational Re$earch Project. Lackland AFB: 
Air Force Human Resources Laboratory, January 1974. (Report No. AFHRL-TR-73-76; •NTIS. 
Availability: AD.774-574/8GI). 

Archer, Joann R.. and M. Joyce Giorfia (eds.). Bibliography of the Occupational Retetrch DMikm, 
Air Force Human Re$ourcet Laboratory (AFX). Lackland AFB: Air Force Human BMMices 
Laboratory. July. 1974. (Report No. AFHRL-TR.74-56; •NTIS AvailabiUty: None stated). 

These two publications provide the reader a well documented explanation and history of the 

CODAP svstem. 



♦National Technical Information Service 
5285 Port Royal Road 
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THE POSITION ANALYSIS QUESTIONNAIRE (PAQ): 
FROM THEORY TO RESEARCH TO PRACTICE 



Robert C. Meichim 
Utah State University 



To gam a cuiniilt u* picture of the Position Analysis QuMtionnaire this paper his been d;rtded 
into three :icctii>ns dealing with ( 1 Hhe theoretical underpinning sug|estin| the development of the 
PAQ, (2) the rt-HMrc h dune with the PAQ, and (3) the practical procedures for using the PAQ at 

present. * 



Supporting Research and Theory* 

The ide^ f hat there are differenees among people which lend themselves to particular occupa- 
tions is of ancient iiri^in. Plato expressed the notion as follows: "I am myself reminded that we are 
not all alike, there are diversities of natures among us which are adapted to different occupations.*" 

The systematic investigation of the relationship of hunun characteristics to job cbaracttristics 
IS apparently of mure recent vintage. From theinmttgations of GaHon, Binet, CatttU, and others, both 
the confirmation of the concept of individual diffemices emerged as well as the impUcetion that at 
least some hum^an characteristics could be identified, quintified, and used to allocate human reaources 
where the contribution proved greatest (Linden and Linden, 1968). The finding, for exmple, that 
people in the same occupation tended to have aptitude and ability scores more nearly alike than the 
general population (Harrcll and Harrell, 1945; U.S. Department of Labor, 1967) offered further sup- 
port to the idea. That factors in addition to the aptitude and ability domain were aho present has 
been confirmed b> Strong (1943) and others who have found a tendency for persons in ghren occupa* 
tions to be more aHke in terms of interest than is the general population. 

i Frnm this, viry htief review of history one may conclude the following: 

A. Individual differences in aptitude, ability, interest, and other domains do exist and are 

frequentU nf considerable magnitude. 

B. Job^ presi nt requirements that are better met by persons possessing compatible character* 
istic5. and because of the rewards associated with compatible relationships, p^ple will 
selectiveU migrate from jobs of less compatibility to those of more compatibility and/or 
attempt tn make changes in the job or themsehres; and, 

C. The movement of human resource^ to the points o) optimal utilization and personal satis- 
faction can he accelerated by identifying both relevant human and job characteristics and 
arranging for a compatible relatk>nship through person-job matching, or, where possible 
and desirable, alteration of either human of job characteristics. 

The foregoing historical sketch and the conclusions therefrom are, of course, not new to the' 
mdustrial psvchologist and others who have attempted to improve on the matcji between people 
and jobs. This is evidenced by the considerable effort that has been expended in the areas of test 
development, standardization, and valklation. Nor have attempts to understand the characteristics 
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o( Jobs been on d smA\ ^ ale its evidenced by the work of conference participant the United States 
Bureau of Labor with lis Dictionary ofOccupationol Titles (D.O.T., 1965), and othtn. Howtm, ^ 
with the adveat of modern statistical and psychomeuic methods and the hixh-sptrl tomputtr, one*« 
perception as to what is possible has been fradually modified. The conflutnct of the theory accom- 
panied b) an increaung technical capability to realize iu application hasled td a numbar of experi- 
mental attempts at person-job matchinc- The remainder of the paper will focus on the research con- ^ 
ducted by E. J. McCormick and his studenu at Purdue University from the late 50's to the present, 
as well as contributions made by a number of other investigators. ^ 

Devt'lupmeni uf the PAQ 

Describing the Job 

One major problem in matching people and jobs has been the difficulty associated with obtain- 
ing relublr descnpuve material about jobs in a form which could be related to data about people. 
While the dau about peo^Je could often be collected and presented in tiumertcal form, job descriptions 
were usually uf a written nature, thereby prohibiting the use of statistical procedures to discover rela- 
tionships between people and job data. Several earlier ^ttempU had been made to quantify job data 
bv having raters judge the degree to which the job required certain human characteristics (see, for ex- 

' ample, the Job Psschograph by Viteles, 1932; the J<oefficient approach by Primoff. 1950, 1955. 

^ 1957. 1959, and trait ratings found in Volume II of the D.O.T,, U.S, Department of Labor, 1965)- 
While such a ratmg approKh often yielded reliable data, the usefulness of the data was often less than 
that deslied as the ratings often did not correlate very highly with the measured characttiistics (par- 
ticularly psvchomoiur ) of persons performing the job (Trattner, Fine, and KuWs, 1955; Mecbam and 

. McCormick. 1969). U seemed that the research dictum that jteopie are relatively good oberrven but 
rtlauvely poor at determining what the observations nieanjhad as much relevance here as elsewhere. 
This led quite naturally to the conclusion that a rating me^odology which yieMed numerical data 
should be focused on the recording of what could be observed or easily implied from observable 
!iourcf!S. and that what it meant should be relegated to statistical procedures capable of more accurate 
and r« impale analvMs than what the rater could offer. 

While in the«>r\ i.ne could construct a checklist to describe every type of job Ktivity, in practice 
nui h a i hecklut would be burdensome to construct and use if jobs of divergent composition were to 
be considered m a single checklist. Nor would such a checklist be immune to the ravagas of changes in 
jc>bs brouf^i on by technolog> and job redesign. One is left then with a dilemma: how does one 
utilize the observational superiority of the human rater by limiting the rat'mg task to the recording of 
observations and tt the same time utilize the data analysis capabilities of modem statistical and com- 
puter procedure^ to determine the relationship between human and job data. Furthermore, it must be 
done in a practical such thet.it is applicable to jobs of many types. One pooible compromise sol- 
utlBh was offered by McCormick (1959) in terms of the "worker-oriented** job element. Briefly, the 
reasoning is as follows. (A) there are a limited number of elemental behavbn in which any person can 
engage, with the number of these behaviors being limited by the biological characteristics of the hu- 
man being, and (B) ihesA* behaviors may be exhibited in a variety of technological contexts, but the 
types of phvMca! and mental behaviors in the human repertoire remain constant across jobs and 
thriiUgh'Vut changes in tethnolog>\ Thus emerged the concept of the "worker-oriented** job element. 
Man\ nl \ou will reiogni^c a kinship with the "elemental motion" idea from Time and Motion study. 
The worker-oriented job element was generalized, however, to include the entire 1)ehavioral repertoire 
uf the human beuii* 

Ome thii^ iontvpi was theunzed. work proceeded to define the worker -oriented job elements. As 
a sutrtm^ p iini, t ht fumilhir Stimulus Oruanusm Response (S-O R) model of behavior was adopted as 
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a truniewurk for identifying these elements. For example, from the stimulus side of the model, the 
various senses used in observing stimuli were noted (i.e., vision, hearing, smelling, etc.). The task then 
became one of identifying job behaviors which required use of one or several of the senses. Likewise, 
various reasoning, decision making, and other mental processes were cataloged under the ''Organism'* 
section of the model while the *'Response** section dealt with psychomotor aspects of the work in- 
cluding the types of tools typically used on the job. In addition, items were developed covering the 
social and physical context in which the job was performed. The process of defining the range^of 
items to be used and refining the individual iter.is has been an evolutionary one, having begun with the 
early work m the late 1950 s and continuing through to the present time (McCormick, Jeanneret, and 
Mecham, 1969 K - ' 

Determining the Relationship of Job Data to People Data 

Once a structured j(>')analy^s instrument had been developed (the I'osition Analysis Question- 
naire), it became possible to statistically explore the possible relationship which might exist between 
jobh and the per^!e who are attracted to and perform those jobs. Was there, for example, a predict- 
able relationship between certain job characteristics and certain aptitude and kbility characteristics as 
implied by the concept of synthetic validity (also referred to as indirect validity, generalized validity, 
and job component validity). This notion, as stated by Balma (1959), involves the following: 'The 
inferring of validity hi a specific situation from a logical a^alysi&of jobs into their elements, a determi- 
n.ition of test validity for those elements, and a combination of elemental validities into a whole.*' 

Wa5 it now possible that factors such as vocational interest known to be associated with the 
person job match could be identified and investigated in much the same? Would it also be possible to 
find the relationship of job characteristics to wage and salary levels and formalize a new method of job 
evaluation? Could jobs be classified, creating job families and combining similar jobs under the same 
title? According to their similarities, could one flnu the particular characteristics associated with jobs 
w hieh t:.'nd toward worker satisfaction or dissatisfaction? 

In a word, \es. Each of these relationships could be and have been explored. In brief, the re- 
search in each area may be given as follows. 

Synthetic Validity. Mecham and McCormick (1969; see also, McCormick, Jeanneret, and 
Mecham, 1972) found strong multiple correlations between mean test scores for job incumbents on 
the General Aptitude Test Battery (GATE) and PAQ factor scores. For the 90 jobs studied, the coef- 
t Aient.> rani^ed from .60 to .BO for tests of a cognitive nature and from .4^ to .71 for psychomotor 
tests. Weaker but good multiple correlation coefficients were also found in predicting validity coeffic- 
ients, the standard deviation of test scores for job incumbents, and the ^sability of the tests in a final 
test battery for selecting job applicants (McCormick, Mecham, end Jeanneret, 1973). These results 
have been supported by the later investigations of Marquardt and McCormink (1974). 

Vocational Interest . In 1972 the PAQ was moditied to determine how attracted to or tolerant 
of various job characteristics a person was. Rather than indicate the degree to which each element was 
found m the job, the person was instructed to . . indicate the l^vel of your interest in the activity 
or situation as a part of any job th>t you might consider." The Moulting instrument (later named the 
Jt)b Activity Preference Questionnaire-JAPQ) was found to haye acceptable reliability (Harris, 1971), 
and in : n unpublished study witn high school students was found to predict relatively well their grade- 
point averages (r ^ .50). Later, Peterson (1974) found in a comparative study that university student 
madepoint averages could be predicted as well or better, with JAPQ data as with data from the Strong 
Vocational Interest Blank. A:;other study indicated that the closer the match between a person s 
JAPQ data and the characteristics of his/her job as measured with the PAQ, the higher the preference 
for the job (Longhurst, 1973). Job satisfaction was found to be related to both the level of certain 
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JAPQ and PAQ factors and D*^ dif^'erences between them on the job in a study by Calitz, Hilaael, 
McCormick, and Peters (1974). This followed similar findings by Prjtchatd and Peters (1973) with 
a large sample of enlisted naval personnel. 

Job Evaluation. As ont goes through the PAQ, it is easy to observe many of the types of fictors 
which have been used to assign jobs various rates of compensation. With this view in mind, PAQ data 
were correlated with going rates of pay on 340 jobs (Mecham and McCormick, 1969; McCormick, 
et al., 1972) and considerable predicubility resulted with multiple correlation coefficients in the mid 
to high .80's. From this early work, studies weje conducted with the U.S. Navy (Harris and 
McCormick, 1973) and in civilian organizations (Robinson, Wahktrom, and Mecham, 1974) in which 
regression equations were used to predict the compensation rates for various jobs. In brief, the ra- 
tion^e was to "capture," using a multiple regression approach, the relationship between job character- 
istics and going rates of pa>, either as found in a general labor market area or in a given organization. 
Then, the relationship derived (in equation form) can be used to extend the compensation policy to 
-other jobs found within an organization. At present, such a method has been or is being used in a 
number of organizations. A word of caution is in order, however, before leaving this subject. It has 
been relatively difficult to **capture** the underlying relationships between Job characteristics and rates 
of compensation when viewed across organizations with the recent volatility of wage rates 
(McCormick, DeNisi, and Marqaardt, 1974). Furthermore, for highly paid positions, it has always 
been difficult to find d stable relationship between PAQ measured job characteristics and compensa- 
tion rates, 

Combmin^ Jobs into Families. One of the possibilities when one uses numerical job data is that 
of grouping jobs together based on their similarities. Such groupings have been made, using several dif- 
ferent metlu)ds (DeNisi and McCormick, 1974; McCormick, et al., 1973) (i.e., BC-TRY, CODAP, and a 
modified d" hierarchical grouping approach). In some cases, lo\k from various samples have been rela- 
tively homogeneous and in others'rather heterogeneous. 

Miscellaneous'Inquiries. A number of other types of pote.ntial inquiries have been suggested. 
Briefly, these mclude the derivation of structured interview forms from PAQ data; the use of past job 
experience (either.coded on a form such as the PAQ or listed by D.O.T. number) in assessing qualifica- 
tions for selection, transfer, and training decisions; the use of PAQ data to develop methods of per- 
formance appraisal, poi>sibly in terms uf the dollar value of behavior in given areas of the job; and the 
development uf human resource accounting procedures using PAQ and related predictor data as a base 
(Mecham and McCormick, 1974). 

No doubt home of these ideai> will prove feasible and othors emerge as research continues. 



The Use of the PAQ at Present 

Some 300 U.S. and foreign organizations have used or are presently using the PAQ for some pur- 
pose. This section of the paper will be addressed to the procedures employed in its ut^ilization with ex- 
amples of the typeb uf resuUs one can expect. First of all, users obtain a Users* Manual, a Technical 
Manual, and sufficient PAQ*s and Record Forms to analyze the desired positions. Instructions tor de- 
signmg the data collection phase or an organizational study are found in the Technical and 'User's 
Manuals with specific instructions on analyzing jobs found in a Raters Manual (Marquardt, in prepara- 
tion). In brief, however, most studies utilize independent sources of infdrmation about each job ana- 
lyzed. A t.vpical arrangement would be to have PAQ s independently completed by an experienced in- 
cumbent, a supervisor, and an analyst for a given job, or alternately have PAQ's completed by three 
analysts. The number of completed PAQ s and the sources of information for a given job depend on 



4ii 

42 



the reliability one desires in the data and the perceptual framework from which th. job is to be-ana- 
lyzed. For example, one study found that supervisors and incumbents systematically provided ratings 
which were somewhat different in predictable ways from those provided by trained analysts (Smith, 
1975), thus underscoring the importance of using a consistent configuration of data sources. 

Once a sampling design has been made and those persons selected and trained to do the analysis, 
the analyst, incumbent, or supervisor begins to record the degree to which each job element applies to 
the job being analyzed, using the scales provided. This involves going sequentially through the ques- 
tionnaire and responding to the elements as they are grouped into six divisions, entitled: (1) Informa- 
tion Input; (2) Mental Processes; (3) Work Output; (4) Relationships with Other Persons; (5) Job 
Context, and, (6) pther Job Characteristics. For supervisors and incumbents, this entails simply read- 
ing through the questionnaire andaesponding on the Record Form. For analysts it means interviewing 
an incumbent and or supervisor, preferably near the work pidce^ and rating elements based on 
observation and questioning. 

Following the data gathering, any or all of three different checks for data consistency may be 
made. The first check, called the '^Preprocessing Data Check,** involves forvyarding the Record Forms 
to the Data Processing Division with all analyses for given joba grouped together. The forms are then 
bt^anned and differences between forms for th^ same job are noted. With this information, the user 
ma\ th^n seek additional data on elements which lacked similar responses. A second method of 
checking the data for consistency involves the deriving of factor (or dimension) scores for each Record 
Form 2«nd then comparing all Record Forms for the same job across all factors. This will reveal if dif- 
ferences in the way individual Record Forms were rated ar* sufficient, when elements are pooled, to 
be of concern. A third type of check involves computing factor scores for all or a s^nplc o' the 
Record Forms, pairing Forms for each job, and computing inter*rater reliability. This w;** reveal the 
reliability of the data generally and determine which factors are most stable. It also will provide reli- 
ability estimates for data averaged across various numbers of raters and is used in later analyses to indi- 
cate the error associated with various estimates. 

Once the user is satisfied tha; the data are reliable enough for his/her purposes, the data (either 
from individual or averaged Record Forms) are typically processed to produce factor (dimension) 
scores showing the relative involvement a job has with different aspects of work in comparison with a 
varied sample of jobs from the U.S. economy. This type of information may be potenHilly useful in 
developing performance appraisal techniques, identifying job characteristics for employcnent inter- 
viewing, assessing training needs, etc. For ease of interpretation, the scores are given both numerically 
(in Z score form) and plotted in terms of percentile wich the estimated standard error of measurement 
indicated. Dimension scores are calculated from elements in each individual PAQ division and for ele- 
ments from the entire PAQ. ^ 

From these basic dimension scores, estimates are then made of the expected general ability char- 
acteristics of incumbents as a group on the job. For example, the mean scores are estimated for the 
aptitudes measured by the GATB, along with estimates of the standard deviation of the expected test 
score distribution, estimated validity coefficients, the likelihood that tests would be found in a final 
test battery, and a set of estimated cutting scores on the three tests with the greatest likelihood of use 
in a test battery for the job. Such cutting scores would have typically eliminated about one third of 
the workforce present on jobs of this type. Such information as this has been useful in t«st selection 
and establishing the **job-relatedness** of a given type of test for a panicuLr job. Because of an Em- 
ployment Service policy prohibiting the release of GATE test scores to employers, the data has thus 
far been usable only indirectly. It is anticipated, however, that a new battery entitled the Occupa- 
tional Aptitude and Ability Test Series (OAATS), which has been under development by the author 
fur the last year and a half, will be published and made available to qualified organizations early in 

43 



1976. It is hoped that with the accumulation of normative and validity information, the same types 
of estimates as are presently made for the GATE will be available for direct use by employers with 

OAATS. 

Also included is a general estimate of the compensation level for the job in terms of ''Predicted 
Job Evaluation Points.** This type of prediction becomes important in establishing wage and salary 
policy and in determining internally equitable pay rates for organizational jobs. Thaae data may be 
ordered for all jobs in the organization to establish a hierarchy of jobs and to identify jobs whoae pay 
rates devii^te significantly from jobs with similar characteristics. These predictions may also be modi- 
fied to reflect the community labor market by collecting area wage and salary data and making appro- 
priate adjustmenu. Another alternative is to simply develop a regression equation based on present 
organizational pay rates using PAQ data to predict those rates, and then simply proliferate the policy 
with new and changing jobs. 

Quite aside from predictions generated from dimension scores is the dirret use of dimension 
scores to determine similarities between j >bs or to group jobs into families based on thoae similarities. 
This is achieved by a modified hierarchical grouping technique which interatively groups jobs by 
profile similarity. First it calculates the similarity between each job and every other job, grouping 
the two jobs together which are most alike. This process of testing for and grouping by similarity 
continues until all jobs ultimately are placed in a single group. The degree of similarity within the 
different groups of jobs is indicated by measures of profile match. 

This type of information has proven valuable in several contexu, including the combination of 
similar jobs with separate titles under fewer titles; the use of validity generalization from one job in a 
family where validity data is available to other similar jobs in the family ; and the determination of 
whether jobs with similar titles s^re disparate enough to warrant separate titles. 

While these are the primary uses which have been made of PAQ data to date, at least one other 
exploratory use deserves mentioning; that being the usf of the JAPQ in conjunction with PAQ data 
to aid in matching job preferences with job characteristics. At present this is done simply by match- 
ing the dimensic profile from the JAPQ with the PAQ dimension profile for about 700 different 
jobs. The jobs most similar are printed first with those less similar printed thereafter ordered in terms 
of similarity. Also printed are expected GATB score ranges for job incumbents and expected compen- 
sation ranges for the jobs listed. Additional work is planned to simplify interpretation and, looking 
into the future, it may be possible to provide the vocational counselor with estimates of how well a 
person s aptitudes and interests match a truly large and up-to-date sample of jobs. 

By way of summary and in conclusion, the existing theory of matching people and jobs makes 
it clear that meaningful movement and change naturally occur to lead to a more rather than less com- 
patible relationship between people and their jobs and that the matching process can be enhanced 
using modern statistical, psychometric, and computer procedures. The PAQ with its attendant pro- 
cessing procedures is a major effort to accomplish this end. 
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INFORMATION MAPPING; HOW IT HELPS TASK ANALYSIS 

Robert" E. Horn 
Information Resources, Inc. 

DEFINITION 

A METHOD which brings together current learning research and 
instructional technology into a comprehensive design and presentation 
technology for making communication easier and quicker. 
A SYSTEM of principles and procedures for identifying, categorizing 
and interrelating information required for learning and reference. 

AIMS 

TO MAKE EASIER AND QUICKER . . . 

1. Learning and Reference Work 

2. Preparation of Learning/Reference Materials 

3. Maintenance of Learning/Reference Materials 

PRODUCTS: 
Books for SelMnstruction and Reference 
Data Bases for Computer A.<;sisted Instruction 

WHAT IS NOVEL ABOUT INFORMATION MAPPING? 

1. Paragraph/frame replaced by 

A. Information Blocks 

B. Information Maps 

2. Simple, comprehensive, modular, expandable classification system 

3. Can be used for different purposes with minimal changes 

4. Ready-to-use» consistent formats for different types of 
presentation purposes 
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HOW INFO-MAPPING HELPS TASK ANALYSIS 



ASPECTS OF 
INFOMAPPING 

Clamficatioii Syftem 



Display Formats . . . 
Modularity of Block 



Concruity Betwten 
Clawfication System 
and Display Fonnats . 



HELPS IN 

THESE PHASES.., 

H*lpad in structuring Ufge 
bodias of ioh/subjact matter 

Helped in data Catherine 
phase 

Helped faciliUte constant 
chance of product/system/job 

Helped SME and manacerial 
review 



CONCLUSIONS: 

-"Natural'^ 

- ''Easy to work with'' 

- FaciliUte acquisitioa 
of information 

— Aids modification of 
documents ' 

— Intermediate docu- 
ment looked more 
like fmal product 



INFORMATION BLOCK X 

. DEFINITION 

The smallest part of an Information Mappinc Analysis. A block 
consists of 

one or more sentences (or diacrams) about a fragment 
of subject matter 

a label (which describes the function or contents of 
the block, such as '^definition," '^example," etc.) 

A Block is always part of an Information Map. 



SOME PROPERTIES OF BLOCKS 

1. Modular 

^ 2. Defined functionally 

3. Rules for 

including/excluding 

display 

order 

number 
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INFORMATION MAP 
DEFINITION 

A collection of information blocks (diipUyed in 
a particular format) about a limited topic. 



BASIC 
MAPS 

concept 

—procedure 

—process 

-structure 

classification 
-fact 



ALL SENTENCES AND DIAGRAMS 
can be sorted into . . . 



SUPPLEMENTARY 
MAPS 



LEARNING 

"-overview 

—compare and 
contrast 



REFERENCE 
—indexes 

—tables of contents 
—summary tables 



QUESTIONS 

—feedback 

—practice 

—review 

—pretest 

—prerequisite 
--posttest 



FIELDS DRAWN UPON: 

1. Educational Technology 

2. Learning Research 

3. Human Factors Research 

4. Dbplay Technology 

5. Effective Writing Principles 

6. Logical Analyses of Subject Areas 
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INFORMATION MAPPING USES THESE ASPECTS OF SYSTEMS APPROACH 

1. Careful ^'fronttnd inilysts'' 

2. RigOi9U8 specification of learning objectives 

3. Learning hi^rvchy analysis 

4. Criterion*referenced performance tests for initial learning 

5. Frequent use of feedback questions 

6. Formative ar4d validation testing 

7. Algorithms, decision tables, flow charts of all types " 

8. Branching of :a11 types (where needed) 

HIERARCHICAL SYSTEM 

• 

COURSES 

UNITS 

MAPS 
BLOCKS 

DEVELOPMENT PROCEDURE 



1. Front End Analysis 

2. List Procedures 
o. List Knowledge 

4. Write Evaluation Events 

5. Identify Maps and Key Blocks 

6. Write Key Blocks 

7. Sequence 

8. Complete and Edit 

9. Test and Revise 
10. Implement 
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USES 



1. When need to prepare written materials that do 
not already exUt, and . . . ^ 

2. When subject/job area it baacally . . . 

Conceptual 

Procedural 

Koce« 

Clasificatbn 

Structural 

Decisional 

INFO-MAP TAXONOMIES NOT YET DESIGNED FOR 

1. Historical Reports 

2. Pr<^t Planning 

3. Arfue for/a|aLnst a Thesis 

4. Simulate Etrents/TVansactions 

5. Interpersonal Training 

6. Psychomotor Training 



BUSINESS APPLICATIONS 



INipRMATION MAP TYPE 



COMPANY APPLICATION 



DOCUMENTATION 



-computer propam documentation 
-early specification of equipment 
—project records 



REFERENCE 



--company proctdurts books 
-Hechnical handbooks 
—sales reference books 



INITIAL ^EARNING 



-Hechnical training materiab 
--operator training materials 
-maintenance training 
-functional (sales, finance, etc.) 
training 



ADJUNCT 

PROGRAMMING ^« 




tion mapped materials 
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WHO USES rn 



^-Western Airlines 
-Datsun Motors 
^Hartford Insurance 



-Citibank 



-Public Finance 

-CranfieW School of 
Manifeinent (U.K.) 

-Frito-Lay 

-Harvard School of 
Public Health 

-Royal Naval School 
(U.K,) 



-f licht atttndanu 
-ticket aiid freight afents 

—mechanics 
-internal procedures 

— afents 

— underwriteri^ 

""tnaoagers 

-ckrks 

—internal memos 

--salesmen 
clerks 

---manaiement trakiees ' 
— manafement traininf 

—task analysis 
-physicians 

—training technoloipsts 



COSTS AND SAVINGS 



FOR WRITERS OF INFO-MAPPING 

-no more than method* vou currently use 

-^viniss of 5 to 20 percent reported 

Hess TA time to write 

-less restructuring dsx^uments 

-less SME and management review time 

easier modification of document 

-earlier precision about block contents 

-ease of allocation and manacement of 
I writing tasks in large projects 

-ease in ability to put material of 
several writers together 

-when single learning-reference document 
possible, savings in production costs 
over 2 documents 



. . . AND FOR LEARNERS 

-up to 3(n better retention * . 

(according to Western Airlines author) 
—decrease in individual training time 

(because of scanning-aids) 
decrease in reference/releaming time 
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ADVANTAGES 



To the learner/user 

A. Fleribk! 

B. Ltirning eaner 
C Retrttval eaner 

To the designer/writer 

A. £ue of writing 

B. Ease of managing project 

C. Ease of modifying 

To the researcher 

A. Unit of measure 

B. Flexible 
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THE MARINE CORPS TASK ANALpiS PROGRAM 

Harold L. Angle 
Office of Manpower Utilization Headquarters 
U.S. Marine Corps 



The Marine Corps Task Analysis Program has been fully operational since 1969. At that tiire the 
Office of Manpower Utilization was activated as a branch of the Marine Corps Headquarters, in Wash- 
inKton. Since then, we have moved to the Marine Corps Base at Quant ico, Virginia, which is about 35 
miles south of Washii:gtcin. ^Vc^ remain an integral part of the Headquarters, however, havirig dual roles 
' as both branch and field activity under the Manpower Plans and Policy Divisbn of the Manpower De- 
partment. We are separated from the Chief of Staff by only two echebns. This places us in a good 
position not only to perform task analysis but to follow up with the staffing actions needed t6 effect 
the organizational changes suggested by the analysis. 

It should probably be pointed out that the Director of Training and Education is not in our com- 
mand chain, but is in a parallel relationship to us. He works for the same DC/S, Manpow^^r that we 
do. The placement of our program under Manpower Plans and Policy rather than Training ha^. had an 
Effect on the development of our program. 



DIRECTOR 



A/DIRECTOR 



ADM 



OCS 



HD, TASK ANALYSIS SECTION 



STUDY 
UNITS 



OPERATIONS SUPPORT 
UNIT 



I 

DOCOMENTATION 

ur>iiT 



ANALYSIS 



PROGRAMMING 



SUPPORT 



Here is the organization of our office. We have recently reorganized to permit a degree of special- 
ization in the areas of analysis and documentation. Formerly, each task analysis project was assigned 
to one of several identical project teams . A team was responsible for every aspect of the task analysis 
process, until the final report had been acted upon by the Chief of Staff. There were three main dis- 
advantages to the project team approach: 
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• utilization o"^ the enlisted Mirines is etch team was on a **feast or famine** basis. They tended to 
be over- or underworked, depending on which phase a particular project was in at the time. 

• Training time necessary to bring each new member up to a satisfactory competency level was too 
long, because everyone had to learn every phase of task anslysis. 

• We were putting out a non-standard product. Each' team developed a unique style, which was 
particularly obvious in the documentation produced—for example the Task Inventory Questionnaires 
and the Task Analysis Reports. A firm effort to achieve uniformity, while retaining the old organiza- 
tional structure, had been a total failure. 

Before we leave this diagram please note the block titled ^'OCS.** Hiis is our Occupation^ Classi- 
fication Section, which publishes the Marine Corps Military Occupational Specialties Manual. This 
book systematizef the entire job structure in the Marine Corps. Its evolution is continuous, with a 
formal printed chuigc each February and August. 

The Marine Corps categorjzes each MOS under one of several occupational fields. There are pres- 
ently 39 such occupational fields for enlisted personnel classification. Each one contains several 
related MOS*s. In the example shown, only 2 representative MOS's in Occupational Field 33 are 
listed, however thci« are others. In fact, although there is some variation, the average occupational 
field contains about 12 or 13 such MOs*s. This is an important point to keep in mind, because most 
of ourttsk analysis will cover an entire occupational field at once. 



TASK ANALYSIS PROCESS 



1. Construct a task inventory 

2. Administer self-report inventory 
3. Aiialyze, using CODAP 

4. Recommend solutions to identified problems 
5. Secure approval of recommendations 

< • 

\ 

As seen in this list, we go through 5 somewhat overlapping stages in conducting a task analysis. 
This process actually begins with a meeting between our analysts and iippropriate MOS specialists, 
sponsors and other legi^mate interests within the Marine Corps Headquarters. We maintain active con- 
tact throughout the process to ensure that the task analysis will be responsive to their particular needs. 

We then begin to build a task inventory. Actually the task inventory is the nucleus of a larger 
questionnaire. 

This is basically a self-report, paper and pencil. instrument. There are several standard questions 
relating to duty assignmer^t, experience level, education and so forth. In addition, we ask quite a 
few questions specific to the occupation under analysis. In many cases these are questions asked on 
behalf of occupational field sponsors in t' Headquarters. Questions of this nature that do not fit 
the criteria for task statements, per se, are asked in the first part of the questionnaire 



^ I won*t dwell on the task Inventory, itself. All U.S. military servies use the CODAP system 

\ described by Or. Christal yesterday. We all construct an instrument laid out much like that pictured 
here (although I dun*t believe everyone is currently including job satisfaction measures in their oper- 
ational task analysis programs). 
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The main difference may be m the breadth of coverage of our task inventories. Because we must 
construct a task list that covers an entire occupational field, rather than a single narrow MOS, our task 
lists are borad in scope and rather lengthy. Because our main objective has been to determine what 
jobs actually exist within our present occupational fields, we have been willing to put up with the dis- 
advantages mherent in such an approach. However, our task lists, which are all available through the 
Task Inventorv Exchange, may have limited value for such purposes as direct curricula design for a 
.specific technical {raining course. For curricula design, we would have to turn to the job descriptions 
produced during the analysis phase. 

We administer the instrument, in person, at the Marines* duty stations all over the world. We 
mail r)Ut questionnaire.s onl> under the most unusual circumstances, and in those cases we mail di- 
rci tl> in an individual Mari*^e- not to a testing center at the Marine s duty station. We consider it of 
paramount importance that the Marine does not associate the task analysis with a test of his profic- 
iencv . We want him to tell us what he really does-^not what he thinks he should be doing.. 

Our analysis process uses Dr. Christal*s CODAP. By the CODAP clustering process, we are able to 
di'lemiine what jobs actually exist within the occupational field under study. 

Vpon completion of the analysis, we write a detailed report to the Chief of Staff, highlighting 
an> problems we encountered in the Occupational Field and recommending specific solutions. These 
problems ordinarily fall into the areas of structure, classsification, assignment practices or training. We 
have made a total of 302 such recommendations thus far, and exactly 300 of these have been ap- 
proved and ordered executed. 

Of course this sort of success rt^cord implies a lot of staffing with each of the Headquarters agen- 
ties whose nonconcurrence could ''kill** any recommendation. This is precisely what we do. In the 
:tnal phase we stop acting like a field office and start acting like the integral part of the Headquarters 
that we arc. This process usually involves three or four staffings, with partial revisions to the report 
between staffing. Depending on the complexity of the study, this phase can last from six months to 
wtll over a year. We spend more time in the last phase shown here, than in the first four phases com- 
binod, and this eats up a lot of our available manpower and time. 

When the Office was activated in 1969, it was anticipated that it would take about three years 
to get through ever> enlisted occupational field. The Office is now six years old, and we haven *t yet 
rr.ade it through, for the first time. Part of the reason is that we have had to r>erform several special 
ta.sk analvse.s, in addition to the enlisted occupational fields. But the main reason is probably the time 
consumed in securing approval of our recommendatiolns. ' 

We wouldn't have it an> other way. The real payoff in task analyses is not an elegant final re- 
port, rtplelc with graphs, tables and a long bibliography. It is in the real world changes that result 
m efficientes in manpower utilization. 



TASK ANALYSIS PROGRESS 

Billots saved 369 

One-time material savings $415,000 
ANNUAL training savings: 

Man-vears 614 

Dollars $5,370,617 

BASED UPON 300 APPROVED RECOMMENDATIONS 
IN 25 COMPLETED TASK ANALYSIS PROJECTS 
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The figures shown here represent our best estimate of what the Marine Corps Tisk AnilysU Pro- 
gram has saved, and is saving, in manpower and training costs. These figures are conservative, and do 
not reflect inflationary cost increases over the past few years. These are net figures. Some of our rec- 
omendations cost money, such as when we determine a need to create a new formal training program. 
However, on balance, our program has resulted in large savings. Considering that our total operating 
budget is under $80,000 per year, we have a pretty good cost effectiveness ratio. 

Now I would like to walk through one quick example of the way task analysis can affect the 
siructua' uf an occupational f ield and the training requirements to support that structure. This is an 
old jfctudy, but it provides an unusually clear example, so we continue to use it for illustrative purpoaes. 



OCCUPATIONAL 
FIELD 65 

AVIATION ORDNANCE 



MGYSGT 


6511 


MSGT 


6511 


GYSGT 


6511 


SSGT 


6511 


SGT 


6511 


CPL 


6511 


LCPL 


6511 


PKC PVT 


6500 



MUS TITLE 

6500 Basic Aviation Ordi^anceman 

65 1 1 Aviation Ordnanceman 



When we began the atud>, the occupational field looked like this. There was a single MOS, above 
the tramee level, indicaung thai all jobs in this occupation field were the same, except that the work- 
ers Vfc^re distinguished from the .supervisors by military grade. The important point here is that every 
new member of the aviation ordnance field went through the same training program, which at that 
time totaled about 23 weeks. 

There were about 1700 enlibted Marines in Aviation Ordnance, at the time of the study. We con- 
i»trutted a ta^k inventor> ba^ed un detailed observation and interview of more than 200 job incum- 
bents. We then admmibtered the self repurt inventor> to more than half the Marines holding MOS 
6511. Thus represented 88'^ uf all Aviation Ordnance Marines assigned to the commands selected for 
administration. 
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JOB/SKILL AREAS 
OF 65 

AVIATION ORDNANCE 



SUPERS/INST/ADM 



AVN ORD 

OPS 
(OMA) 



AVN ORD 
TECH 
(IMA) 



AVN MAGAZINE MAN 



When the CODA? overlap diagram was analyzed, we found something like this. The supervisors» 
instructors and administrators were easily distinguished from the technical personnel actually per* 
forming "hands on'* work. No surprise here! 

The surprise came in the analysis at the worker level. Rather than confirming that there was one 
technical jobs, as represented by MOS 6511, the analy»s revealed three clearly distinct jobs: 

* At the Organizational Maintenance Activity (OMA), there were the ordnancemen who handled 
munitions at the flying unit. IN effect, these were the Marines whose job it was to arm aircraft for 
combat missions. They used much— but not all— of the 23 weeks of training. 

* At the Intermediate Maintenance Activity (IMA), there were the true technicians. These Marines 
utilized most of the 23 week training program. However, this specialty accounted for only about 12% 
of the Marines in the sample. 

* The third group, shown over on the right, consists of Aviat' h Magazinemen. This group ac- 
counted for nearly a quarter of the total sample. They are th3 ca. < 'rt of the ammunition maga* 
zines. They spend most of their time driving trucks or cutting tht gr around the bunkers. In fact, 
those who perform these functions spend 37% of their time on these wo tasks alone. This group was 
using a little over 2 weeks of the 23 week Aviation Ordnance curriculum. 
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OCCUPATIONAL 
FIELD 65 

AVIATION ORDNANCE 



MGYSGT 






6533 




MSGT 






1 . 
6533 




GYSGT 




6531 




6^41 


SSGT 




1 

6531 

1 

6531 




6541 

1 


SGT 


6521 




6541 


CPL 


1 

6521 


1 

6531 

1 




1 

6541 
1 


LCPL 


1 

6521 ■ 


6531 




6541 



PVT/PFC 



MOS 


TITLE 


6500 


BASIC AVIATION ORDNANCEMAN 


6521 


AVIATION ORDNANCE MUNITIONS TECHNICIAN 


6531 


AIRCRAFT ORDNANCE TECHNICIAN 


6541 


. AVIATION ORDNANCE/MISSILE TECHNICIAN 


6533 


AVIATION ORDNANCE CHIEF 



As the result of the task analysis, here is what the field looks like today. Rather than a single 
MOS, there are 3 MOS*s. As you can see, MOs 6521, which is the magazineman, terminates at the 
grade of Sergeant (E-5). If this Marine stays in servke beyond Sergeant, he must then be retrained 
in order to become a 6531. On the other hand, about 74% of these will not stay beyond their initial 
enlistment. Waiting foi a reenlistment before committing the training resources results in a large 
monetary saving. In fact, restructuring the field so that each specialty receives only the training 
needed for the specific MOS has resulted in some large cost avoidances. 
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OCCUPATIONAL FIELD 65 
AVIATION ORDNANCEMAN 



AVIATION ORDNANCE SCHOOL, CLASS "A" 
CURRENTLY PROJECTED FY 72 AND BEYOND 



Triining Dollar Cost 
Training Man^year Cost 



1,566,547 
226 



PROJECTED lAWTASK ANALYSIS 
RECOMMENDATIONS 



Trainmg Dollar Cost 
Training Man^year Cost 



407,302 
58.8 



SAVINGS 



Training Dollars 
Man-years 



1,159,245 
167.2 



These cost figures were baaed on 1972 training cotti. They are undoubtedly higher now. The 
recommendations that were approved and acted upon in this study cut the occupational field training 
costs by nearly three quarters. It is admittedly unusual to realize such dramatic uvings in a single 
occupational field, however our net aggregate savings continue to grow, and we art airtady beyond 
five-and-a-quarter million dollars per year. 

Because my purpose today is to highlight what we consider special about the Marine Corps Task 
Analysis Program, I will not burden you with details as to what task analysts can and cannot do, nor 
will I attempt to explain the workings of CODAP* Rather, let us review the main points that make the 
Marine Corps program what it is: 

« The fact that we are actually a branch of the Headquarters makes it possible for us to see our 
analyses through to actual implementation of our recommendatk>ns. We really avoid the bureaucratic 
delay that could stifle us, were we to pass our completed analyses to someone el» for further action. 

« Our main goal is manpower utilizatbn. We seek to determine what joba exist and the relatbn* 
ships between those jobs. Though there are training implications bi our studies— and we have had an 
effect on training-our task inventories do not have a primary purpose of supporting curricula design. 
Thif. affects the design of our task inventories* 

• We develop task lists largely from field observation and interviews. To the list of task statements 
developed in this manner, we add task statements derived from course curricuia^ manuals and other 
documents, as well as input ftom selected occupational fieM experta. By this scheme w| airoid the 
circular trap of using present currkula to deflne the scope of the occupatbn being trained. Whenever 
we find any Marine performing a task, we want to include it in the task list to wt can determine how 
many others are also performinf that task. We are not trying to answer the queatk>n "What should 
Marines be doing?'' The question asked in task analysis is What are Maringa doing?" 

* As previously stated, the task list may be ainied simultaneously at several Jobs. It is necessary 
that the list be complete enough so that every Marine can select enough tasks from the list provided 
to account for 100^ of his job. We don't really expect Marines.to write in tasks we left out (although 
we do provide that opportunity). 
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• The Task Analysis Section is lOCTc military, and these Marines trave^ around the world for obser- 
vation and interview and for actual administration of the instrument We consider the on-site adminis- 
tration to be the key to success in our program. Although we have effected economies elsewhere, we 
adhere doggedly to this practice. 

Not only do we present our own recommendations to the Chief of Staff, but we also author the 
MOS Manual, in which our recommendations for structure changes are eventually published. This 
gives us a useful audit check on the entire system and allows us to ensure that nothing g^ts lost 

The Marme Corps Task Anslysis Program is in a continual process of evolution. Although we 
have nearly completed our initial mission, the task analysis of each enlisted occupational field, thi-rt* 
are several new goals that should keep us busy for years to come. 

We will reanalyze a few occupational fields that were already task analyzed during the earlj years 
of the Program. For the most part, these are occupational fields where technological change, such as 
the impact of comput-^rization, may call for a second analysis, in light of a new situation 

We have already performed a few officer task analyses. These have been largely limited to ufticer 
uccupationsi that are technical, or at least relatively well structured. Two of the officer studies were 
aimed at groups of officer occupations, rather than a single occupational field, with the purpose of 
deiermmmg hu\\ much commonality exists among the task performar ce requirement in the separate 
occupations. 

We now plan tu carry combined studies of separate occupational fields over to the enlisted side 
ol the house. The Marine Corps b currently contemplating a revision of the current system of occu 
patiunal fields in order to improve the homogeneity within each field, for the purpose of enlisted ca- 
reer management. Task analysis will analyze groups of occupations in order to enable decisions 
regarding revision of the entire structure. 

Heretofore we have not had a great impact on curricula validation or design. We have embarked 
un a campaign to get closer to the educational community so that the educational benefits of task 
analysis are better recognized. Our first efforts will be in the officer and sentor NCO professional 
trammg programs at the Marine Corps Development and Education Command. We have just begun 
an experimental study to test the feasibility of identifying Staff NCO managerial and leadership tasks, 
b> task analysis. This study is in support of the Marine Corps Staff NCO Academy. We hope to per- 
form follow-on studies in support of other Marine Corps professional schools. At this time, there is 
particular interest in the curriculum of the command and Staff college, a high-level school for Majors 
and Lieutenant Colonels. At that level, there is a need to develop generalized leadership and manage- 
rial skills that have high transferability potential across a wide range of specific duty assignments. We 
hope to develop the task analytic techniques to identify managerial task performance requirements, 
in order to help design curricula that will prepare the graduate for sucQess in a variety of high-level 
assignments. Such curricula can be viewed as transitional in nature, with a goal of facilitating a shift in 
the mode of a student h thought and behavior to that of a high-level manager. We believe task analysis 
has a role in this effort. 

The basic purpose uf a symposium is the exchange of ideas. I have attempted to present this 
somewhat paruchiol view of task analysis, as seen through Marine Corps eyes, in the hope that soine of 
the participants may find a useful germ of an idea hea* or there. All of our task lists are on file with 
the TIE. In addition, we welcome the opportunity to communicate with others in the t*tsk analysis 
business at any time. 
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OCCUPATIONAL ANALYSIS IN THE UNITED STATES AIR.FORCE 



Walter E. Driskill 
United States Air Force Occupational Measurement Center 



Good moming. I am happy to have this opportunity to present the Air Force s operational oc- 
cupational analysis program, for it is a program that yields a high return for personnel management. 
As you will see, there are similarities between our program and the Marine Corps program presented 
by Lt. Col. Harold Angle. As you may know, similar programs are conducted by the Army and Navy 
as well. 

Before describing the Air Force program, I want to describe the relationship between the Air 
For'^3 operational program and the research program described yesterday by Dr. Raymond Christal. 
The operational program is conducted by the Air Training Command, and the results are used in train- 
ing and other personnel programs. Dr. Christal and his research staff, who are a part of the Air Force 
Human Resources Laboratory, provide the techniques we employ operationally, and we are most for- 
tunate that his research continues to provide new and improved techniques. Although the Occupa* 
tional Measurement Center and the Human Resources Laboratory are in different commands, our 
close relationship facilitates both the operational and research programl Over the years in the oper- 
ational program, I have maintained a policy of implementing changes in techniques only after they 
have been validated through research. I believe such a policy be fundamental for an occupational 
analysis program to provide efficient job data. 

In this presentation, 1 describe the operational occupational analysis program that is conducted 
«r the United States Air Force by the Occupational Measurement Center under Air Training Com- 
HiUiid. Occupational analysis provides us with informatbn that is used both for descriptive and 
decision-making purposes. Occupational analysis as we define it in the Air Force basically consists 
of the detailed specification or listing of the tasks that may be performed by job incumbents in a 
particular occupational field and the determination of the percentages of the incumbents who per- 
form each of these tasks. Job analysis also provides task factor data, such u difficulty^ qons^uences 
of inadequate performance, and task delay tolerance, which are useful for making training and other 
decisions. We also collect large amounts of biographical information about job incumbents and infor- 
mation about their work environment, such u the kinds of aircraft they work on and the kinds of 
equipment they maintain. Also useful to us is information about how Air Force occupational fields 
are actually structured. Air Force manuals define jobs in each of the occupational ftelds, but those 
de^riptions are baaed on what is believed to be done in the fields and how they are believed to be 
stiucturnl. Occupational analysis, through a complex grouping analysis program, provides us with 
information on how jobs are actually being performed and how they are organized. Frequently we 
find that our preconception of jobs does not reflect the actual work performed. 

Research that led to the present Air Force occupatbnal analysis program be[;an in 1956, and 
now, 19 years later, occupational analysis has grown into a large and very useful operational program. 
By 1965, the methodology, including the computer programs for analysis, were ready for operational 
implemenution, but it was not until July of 1%7 that the operational program begigi in Air Training 
Command. At that time, the program was capable of surveying 12 occupational fields annually, and 
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gram wa^ expanded to a capability of surveying 24 uccupatiunal fields annually with a staff of 28 
personnel. In 1972, the prokT:ani was again expanded to a capability of surveying 51 fields annually 
with ct total stalf nianninu uf 41. Recently, we obtained additional manning that enables us to survey 
officer utilisation fields and lu stud> management applications of the data. Since the beginning of the 
program in 1967. i»urve>s uf 223 fields have bcHjn completed and 73 more are in progress. 

The Air Forced iu i upational analysis process consists of four distinct steps. The first of these is 
the development uf the jub inventory or description of tasks that may be performed in an occupt* 
tional lield. The xnund step consists of the validation of this list of tasks with subject-matter 
NpecialLNth m tiptratiunal units worldwide. Once the task list is validated, it is then administered to job 
incunibenl^ ihruuuh Cun>ulidated Base Personnel Offices worldwide. Tat f»nvl s*ep really consists of 
two piitt^, the firsil iun,MNt4n.i; vif the computet analjsis of the data and the .nccuikI, of the man analysis 
uf what the infurmatiun means in terms of Air Force classification, assignment, and training. 

In tht' dculupment of a jt»b in\entur> , our inventor> development spei iaiists research reference 
materuil perlinciit to ihc utt upational field being surveyed. From this research they develop a tenta- 
tive list of Uu^ks whuh the> use in face-to-face interviews with subject-matter specialists, first at the 
technical tramm^ i enters rcspun^ble for training in the specialty or occupational field, and second in 
upcTatiunal unitN where j>ubjei l-matler specialists are actually doing the jobs. Om e a point of dimin- 
uhmg returnN in interview^ in reathed, the task list is reproduced and mailed tu .Nubjei t matter special- ^ 
iiits in ujieraliunal uniib in the lontinental United States and overseas foi validation. 

The -i.iminentN, * hanue^ and additions from the field validation are incurpiJrated in the final 
t44w list, UiiaMunall> wt' discover that tasks have been omitted, in these* cases, v^e interview personnel 
tit a,v»ure luveraue, Uvi rall. uur experience shows conclusively that it is unnei.essar> to conduct exten- 
Mve oh>ervattuiMnterviuAN tu describe the tiLsks in aspecialt>. Our furnnJ inventories are growing in 
lt'n>;th In «uu earh eUurts. an inventorv for a single ladder averaged 350 Uisks, Now, a single ladder 
invLnii*r\ avera^t-^ 6nu i.iAs. The increase results from a mure detailed spei ification of tasks. Ini- 
tialh, f«ir example. Ae Would have written a task as follows. ''Align or adjust A\'lK2 laser sys'em 
u>mp«*ni nts Nu;\ \\v would prubabh further delineate the task as tullows. 



A job invvntorv % unsiNts uf two sections. The first section ccmsists uf questions to elicit back- 
^tuund and Aork tMuniwitiun about job inuimbents. We obtain from a jub incumbent such informa- 
ti«jn a.^ his naiTK', ^radi\ suua! seiurity number, uccupatiunal field, and huw long he has been in the 
lafeiT held, and prtseni jub. Iiaumbents names are essential infurmal^m, first, so that we may 
deterniiiie it rtsptrndtniN .ire providing accurate information and second, M^jfiat we may locate them 
lu gain insight intu unique jubs. In addition, we obtain work envircmmenl information, iuch as the 
kind^ tif equipment ihv\ Aurk t»n, their satisfaction with the job, and the kinds of aircraft that they 
Aurk i*t\ \ \iv atnuunt iiWwrmatii»n that tan be obtained through the batki5r*iund inlurmation sec- 
tion H limitk'ss .tad Is e\rrenii-lv useful for making decisions about the julxs that personnel hold. 

Th* s»M.uml tiun uf a job inventor> consists of a detailed listing of tasks that airmen may per- 
Uitm. In t uihpletm^ iLls ih;eptur>, job incumbents first read through the ta>ki; that are listed, check- 
ing th»' ^t>ks rLi? ih» > pertorm in their present job. Once thev have ♦ uniph-ted this procedure, they 
gu bat k and rate v.u h ta4 a« * ufding tu the amount of time thes spend uu it relative tu the others 
thev perturu) \\\ h,u»' tiund fn»m experience that the procedure uf having the re.^p<indent first check 
♦he task N h»* pertur fn> w^t **hU |iruvides a frame uf referent e fur (he ritiini'^ i^ K ss time-consuming 
m the luhi* run 



Ahun ur adjust AVD-2 cockpit controls 

Ahun or adjust AVD-2 ethylene glycol a^d water cuolinu unit^ 

Almn ur adju.st A\^L)-2 transceiver recorders 




6 i. 



The job inventory is administered by Consolidated Base Personnel Offices to personnel whom we 
specify. We use the Uniform Airman Record file provided by the MiliUry Personnel Center and spec- 
ify to the base personnel offices the numbers and types of personnel to whom they are to administer 
the inventory. Our sample is a random stratified sample by skill level, command^ and job location. 
The size of the sample depends upon the size of the career field. In those career fields with 3,000 or 
less incumbents, we obtain a total sample; that is, we try to administer the inventory to each individ- 
ual who has been on the job more than 6 weeks. For occupational fields with more than 3.000 in- 
cumbents, some percentage of that total number is sampled. The largest survey that we have under- 
taken, for example, Ls in the Aircraft Mechanics occupational field which had more than 70,000 job 
incumbents. In this case, sampling involved about 1^ percent of those personnel. 

The job inventories are returned to our organization, where we carefully scan and review the re- 
turns and prepare the data for computer processing. The ^ata are then input into the Human 
Resources Laboratory UNI VAC dual 1108 computer where they are analyzed through the Compre- 
hensive Occupational Data Analysis Programs, commonly called CODAP. CODAP is a series of highly 
complex computer programs thit are used to reduce the large amount of data obtained from the job . 
incumbents in the field into a manageable form. 

As a result of the CODAP analysis, we obtain three kinds of information. Th'e first consists of 
biographical and work information about various categories of job incumbents. We are finding useful 
such information as location of assignment, educational level, equipment utilization, reenlistment po- 
tential, and job satisfaction. The second kind of information pertains to the tasks and percentages 
of incumbents performing these tasks. While CODAP provides a variety of ways of manipulating the 
data, the important thing to remember is that whatever the manipulation, these kinds of basic infor- 
mation are provided, first, a listing of each of the tasks performed by personnel in the occupational 
field, second, the percentages of any given group performing each of the tasks; and third, the percent- 
age of time spent by the members who perform the tasks. 

The third kind of information resulting from CODAP analysis consists of three types of task 
factor data, which Dr. Christal discussed in detail in an earlier presentation. For over 3 years, we have 
collected task difficulty data and now have the^ data for more than 100 occupational fields. Inter- 
rater agreement is very high, and we report data only when the agreement exceeds .90. So far, only 
two sets of ratings have fallen below this criterion. Both sets were from newly created, heterogeneous 
fields in which incumbent raters had limited experience. Even then both seU exceeded ,80. Now we 
are providing training personnel with data on task delay tolerance and on consequences of inadequate 
performance. Because of the recency of this development, I have no observations on how successful 
collection and implementation of the data will be. 

The Air Force has put the data to use in a variety of ways. Among the more important are these: 

1 career field strut turing. in which the organization of occupational fields is validated or re- 
structured; 

2. personnel ire:!;earch. where our data are being us^d by Dr. Christal and his staff to answer 
rt?search problems; 

3. determination of the kinds of maintenance engineering policies that should exist in occu- 
pational fields; 

4. development tesus used to promote airmen in grades E-4 through E-7; and 

5. determination of training requirements and instructional system development. 
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One of the m«or uses of the daU is in the instructional system development model usutlly called 
ISD. This model consists of five steps: 

1. analyzing systems requirements; 

2. definint; education or training requircmenU; 

3. developing objectives and tests; 

A. planning, developing, and validating instruction ; and 
5. conducting evaluation of instruction 

OccHpational data are used in the fint step to analyze system requiremenU, in the second step 
as a basis for defining educaUon and training rtquireratnta, and in the last sUp to conduct tvaluation 
of instruction. We find for example, that when we have already had an instructional system develop- 
ment project in an occupational field prior to an occupational survey, the survey results are very \m- 
ful for evahiating the efficiency and effectiveness of the coune of instruction that resulted from the 
ISD application. 

A most imporunt use of the daU U in determining training requiremenU. 1 would be remiss, 
however, if I were to lead you to believe that we immediately nude significant advances in detennm- 
ing naming requireiTienU upon the initial use of occupational daU. Rather, it was afUr long and ex- 
tensive use of the data that we came to know how to make fuller use of resulU. While, to the vast 
majority of the people who lust use them, occupational daU appear to be very useful, when the time 
comes for them to make use of the daU, they simply are unable to make decisions without some cn- 
teru that are provided by a poUcy-making arncy. Here, I should emphasue that I feel that any or- 
ganization that uses occupational data is going to have to defme some decision criteria. These decision 
criteria are fundamenUl to the effective use of the,datiu 

To show you how we developed Uie decision criteria, let me illustrate some of the kinds of tilings 
that we found in survey results. In a highly complex occupational field dealing with the maintenance, 
repair calibration of precision measurement equipment, such as oscilloscopes and sc'mtillation coun- 
ters, we found that there were some tasks that a majority of the job incumbenU performed, [n otn«' 
words, for each 100 people that were trailed on these tasks, wefound use of the training by 60 per- 
cent or more when the course graduates went to theif first jobs. We found, on tiie other hand, many 
Usks performed by small percentages of the job incumbents. In other words, for every 10 people 
that were trained on these tasks, we had three or less using their training in their first job. Similar 
situations occur in all career fields in the Air Force. In fact, there are some occupational fieWs m 
which no tasks are performed by a large percentage of personnel, whereas in oUiers there are many 
tasks that are performed by larger percentages of incumbents. 

This finding led us to affirm a policy for training which emphasizes providng initial training on 
the tasks for which the probability of performance by airmen in their first job asHgnments is high. 
On tasks for which the probability of performance is low, other means of training, such as Career 
Development Courses, on-the-job (OJT), or advanced or suppltmenlary training; should be used to 
develop proficiency. 

Even this policy statement was insufficient to get occupational data used for decision making 
purposes, and it was necessary to levy some specific criteria for determining training requirements. 
Specifically, when a survey of an occupational field is completed, Air Training Command provides 
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ft' . rsT. • , . • t. , . nut ri-Npun>ible fur UalniiiR. 0 ) For tasks performed by 50 per«ent or more of 
fl\. ir nr>t job, traininu U to be provided so that minimal OJT is required for the 
t . iir^ n I ff ..n fns itiNi jnb. (2) for tasks twrformed by 30 to 49 percent of the job incumbents 
in th. (I tit t i:tKi!. nt. luukuruund or fundamental traininf is to be provided. The intent of this 
•i.simni 1 • f, -K. j'.1>pr.<nr»'iu > training by supervisors easier. (3) for tasks performed by lessthaft 
tu r .„! .! tt p. rs..nnil m their first jobs, it is not cost-effective to train everyone in order to train 
tli. ... Af . . A ill tliiir traininR in their first job. Use of the other task factor daU may refine this 
.(■I f I t, \ n I f . r ..f u> Mme, hov^ever. that for Air Force initial trainint, the most important 
I t, .t I. ;.n >t ,t..i(f \ . .! porfurmancc in the first job. Where probability of performance in the fiwt 
1 ,h i> ). .V t a ^ .fxv . . .nMdcrtd ••critical'* unit training programs are more appropriate for training 
,,„ .1.. « ..I 

( i . .(.(.( .1, .t;. .n ..I thi-se Ruidelines has resulted in very sugnificant training cost avoidance. At 
1 1.. I . V r, t .-x 'u. ,i\ rr.uninn Center, for e.xample, the original course for the Precision Measurement* 
i'quii til. lit -v- A.tN 13 wetks in length. As a direct result of the applicatwn of occupational 
ri.i!.. !i . . MurM A.t^ r-duced tn 32 weeks, representing a 25-percent reduction in course length and a 
.'.li r ^ • ..f ..v.r $1 million in 1 fiscal year. Other significant course reductions have be?n 

tn. -i' is. ..'ti.r J liufs. Overall, with the direct application of ocfcupational'analysis data in deter- 

imn. if .rvio r. uuri m.-nis .ind .<sa part of instructional system development pnigram, highly sig- 

r.i'ii inf ^-tvij.-u- ' ■in f>«." shown. 

f 

. i'.... , n -n.Mt .rtjr manaRemeriiapplicationsstudits, we adapted occupationalanalywstech- 
ni ; 1- . 1. t . < 'fi» !r!..\.«m f itf tnining in electronics principles to the Avionics. Communications- 
f I rr.n!. ' MlsmIi- Mamtenance specialties. Normally, we'sUrt job analy^ with a deUiled de- 

nj. ,11 . >' t h. ' ssk in A sptH ifllty. In our Electronics Principles (EP) project, we started with the- 
\ \ ir'.. <: irr tn. f. T.i-sks representing the principles were written with the assistance of subjed- 
m iv f 4' • 1 .5t^t^ m 'ii- \.iriuu-s specialties. Validatwn studies using small samples reveal that test- 
n s' h u«itt > .1 thf EP mr.irument exceeds .90. Also, the studies tentatively suggest that the rele- 
. ,. . >' r I • ui -hi in uur ti-rhnical courses ranges from very low to moderately high. The instrument 

, , , ^ • . .li t. t. .<i..t. KPn-quircmcnts among specialties. Large-scale administration in three career 
t \>i<i>T. A ii) ff.un m ni-'>-«-nilK'r. 

1 , , ! ; . . f . , . . include b\ pointing out that not all surveys have resulted in the significant 
,1.^ ! . . . , ri..l I ran say categorically, however, that every occupational survey has re- 
. ; II : ..11, h. n.fiL-.. For one tiling, and this fail is frequently overkwked by training manage- 
„' v. - u . . . n ,,hl.- In validate training. It is good to find that the training you are provMing is 
„ ' - 1, . . i-i .-^ where training appears to be off target, we have frequently been able to 

, , , .,. .11 »,.. riall.Kating training time within an existing course. Although the t^al 

. . . |...' h.iw bc-en reduced, we have been able to give more emphasis to some awas 

. r. ;, ! : . Li.. I» ns emphasis to less essential areas. 

r iM 1 . • i r.u** pr» vi'^usK mentioned, we have often been able to reduce training, sometimes 
r , . r I it in.Mimn a days, and sometimes by a ver>- large amount, or weeks of traming. I 
r V , T t1 i .j^* of iHtupatiunal survey data in any training program can result in.a more 

!],* ft ! ♦ft' i»'nt program regardless of the work environment. 
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THK INSTHriTlONAL SYSTKMS M' 1 ( )r 1 HI VOCATIUNAL-TECIlNICALiEDUCATiaN 

ctiNSdirnrM nv stai i-:^ rsi- u v > i !i \M.ur I'Khf{UI.mance objectives, 

t'RlTKRlUX-KKl KaK\CKl> MI \Sl Ul s \\!) H Hi-OHMANrE CUIDES FOR LEARNERS 

Urn \ Hir t Jf 



HV IHi: V(K\\HiiN\L ilMiWKKmrAiION 
roNSf )K ril'M i)F M ATKS TO \1 \N A( ;K THI-: DEVELOPMENT 
I'RciDl rU )N. DISSEMINATION \N!i fMrLKMKNTATlON OF CATALOGS 
OF rHildUM WPF OlUKri IVKS AND iTlHi Hit IN REFERENCED MEASURES 

IN OiTl P VIHinVkM)! C\riON 

WinniivrihW 

Tht^ tullMAin^ nz«*di»l w i h« ri^suli of a study «n n u n tiMii-r models- tht*ie uj*ed b> the Air F«me 
Traininii i'i»mm.tnd. th«* Sl.tt»» t,t FlMrkii, ihr Si.Ur v f Mi^ luj:.uu Slate of Alabamii, Project CA 
RKER yMthm the Siatf *»f M.!v>.u huseits. iht* Kduiatn^nal IVsiinK Sfnice, and the Stalf o{ Utah. 
romp«»n»'nis **i thi* mortcl writ* bt^lfi ird h\ ihv ,ipph* att-.n of i nferw uken from the Agreement Form 
Mf the Vm alit^nal-Terhnira! EduLatM>n T unM»nium if Stati c I V TKCSK the minutes of the ad hoc 
Sftrrmg Cimmmitei* v%hn h formi d fht* Cnn^^rtium. .*nd ^he minute.sof the B*)ard of Directors, 
V TEC S. Simu* m^del Munpun«*nts vM-r** f\\v result *d additiunal ri'seanh conducted through an ex- 
hausUvf* Niud\ uf ihv litt ratur«% i» i ompu. . avMsU .tr» h »»f thf ERIC files, a computer search of 
Journal *trtu !es, ant! a manual scan h «if the Diwrtatton lnti*rratknal Index, 



niEPH\M:U3loDKl 

A* tivit> Niinibir I 
Dtii rnun ttiun of Prioriii..-'. mvi Vs>ii!nmt'nt of Calalupis 

Thts a»ti\ii> lA rh«* nrsi slip for dtvelupmu i at<4 n - **i pt'rformance objectives and criterion- 
ref»"rfnrH mtMVin*v The activit> h,t^ fuur bptsii sul. Nutit-s ^hich form the rationale and c<m- 
sen.sUN for latiilo^ priorii\ idi-ntifiralion and .n^^avnin* id fo Ua* member slates of V-TECS. 

Sub*Aetivit\ M- State Pnonly Delerminati' »n 

The niembiT NUUessitudv data availabli it» »ht*ni * uiuerninu manpower needs, employment op 
portunities, and studeni mtere>t sur\evj\ lu esubltsh a prit*nlv li.sl within the state for catalogs uf per- 
fiirmance tibjetltves and i riteri<m-r»-f< rettced nu .tvurvs A >laU' ma> consider regional and national 
data to determine its pnorihes or an> oih. *iomniii» .ii whu h it dt*c»ms necessar\ or appropriate. 

Sub'Artivity I*2-<'onsortium Prii^rity Determination 

The Board of Directors of VTITS wdl dtscuvs, m turn, the pritiriiies established by each mem^ 
her state. The purpose^ of this struitured diM ussion is^o dew*lop a priority listing from which the 
member state's ma> sii^lec t and hi- .tvsi^ned a t • r?ain nunJ^ r ut t ataluj^ to develop. This sub-actint) 
IS to .Lssure that dupln aiu»n d*jvs not i ur and ^h.a a ^tai* h t^ the opportunity to negotiate for spe- 
iifk catalogs hi whivh it hasa par?i« ulitr int* n <t for v^hif fi loii^identble * has already been 
an omplislied 
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Sub Activity I>3-Resolution of Conflict and Exchange of 
Previous Work Related to Catalog to be Developed 

Should states not be able to resolve priority preference cor.llicU, a drawing of assignmenU will 
be conducted by the Board of Directors. In case a state does not get iU desired priority area for 
reasons identified by the Board of Directore, a ropy of such accomplished worl. would be provided to 
the sUte kssigned the catalog area in dispute. This material will be included as an essential part of the 
state-oT-the art study to eliminate duplication of effort. 

Sub-Activity l>4— Assignment and/or Selection of Catalogs 

The Board of Directors makes the decisions concerning the final selection and/or aisignment of 
catalogs after state and Consortium, priorities have been determined. Two primary conddcrations are 
Riven member states on the selection of a catlog: 

U ) the state has 2 particular ineres* in a domain area 

C2) tne state has accomplished or has in pru^'ress considerable work in a domain area which 
would benefit the Consortium 

Catalogs assi,,..ed by the Board of Directors of thy Consortium are subject to accepUnce by the 
state involved in the assignment. 

Activity Number 11 
The Memorandum of Agreement 

A memorandum of Agreement is entered between the^taU selecting or being assigned axatalog 
to develop and tho Consortium. The parties of the Memorandum of Agreement are the Chairman of 
inv Board of Directors of V-TECS. the Executive Director of V TECS, and the person designated . 
by the Stale s Plan Tor Vocational Education as the State Director of Vocational Education. This ac- 
f iul\ has three sub.activiiiej> which mu.st be completed prior to the developmental work on a catalog 
tnti thi'V are its ful|i»ws: 

Sfth Vh.it> 11 \ MuiMmumOintenU of the Memorandum of Agreement 

The Memorandum of Agreement will be developed by the Consortium staff, and after a period 
*jl umt'. will be .standardized. The Memorandum t>f ajjreement will contain the following minimum 
itemh 

(1 ) date and name of catalog domain area including job titles to be surveyed 

(2) designated signature blanks 
i ( 3 i spocif ic delKery dates for: 

" (a) domain study an^d ta:»k lists 

(b) task analysis and survey results 

(c) catalog of performance objectives and criterion-referenced measures 

(d) field test period 

(0 ) final catalog and field test results 

(4) responsibilities of a full-time technical coordinator in the state and to the Consortium 

(5) Consortium staff involvement in the developn^ent of catalogs and the development of Jn- 
'Service training and dissemination plans 
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SubrActivity Processing the Memorandum' of Ats*.i?ement ^ 

The Memorandi/m of Agreement will take the following course for development^and approval; 

(1) format developed and prepared by the Consortium staff 

(2) Memorandum of Agreement reviewed and signed by the Chairman of the Board of Directors 
and-the Executive Director of V-TECS 

(3) Memorandum^of Agreement mailed to the states for review and signature by the State Direc- 
tor of Vocational-Technical Education 

(4) designated copies distributed and project starts 

(5) periodic PERT reports are mailed to states on request / 



Sub-Activity II-3-Selection of a Project Director 



Each state developing a catalog of performance objectives uid criterion-referenced measures will 
select a person to serve as project director. The project director selects and manages writing teams 
which a.-e composed of selected instructors in the domain heint aeveloped. Thesp writing teams are 
trained by the project director and state technical coordinator to analyze data resulting from the ' 
occupational analysis system, the findings of the state-of-the-art study, and other pertiaent informa- 
tion. The p^'ojeot director is responsible (or submitting to the state technical coordinator results of 
studies and analyses of data, catalogs of performi^nce objectives and criterion-referenced measure, and 
other products required'bv tlie Memorandum of Agreement. The project director will meet the same 
qualifications established by the Board of Directors of V-TECS for the technical coordiiiator in each 
state. / ^ 



Activily Number III - 
Technical Preparation of vfTECS Staff and State Coordinators 

The technical preparation and training of the Consortium staff and the technical coordinators 
in the states are paramount to maintaining quality control. A program of technical development will 
begin with an orientation to the model to insur^ that technical skills and knowledge are sufficiently 
developed to provide maximum quality control. This activity is divided into six sub-activities which 
form the basis for staff preparation and trainin^and are as follows: 

Sub-Activity Ill-l-System Orientation 

A program designed to insure the perform^m^^e of Consortium staff |ind technical coordinators 
will be administered. The orientation is in performance terms with eacli person satisfactorily complete 
ing ^e required tasks at a criterion-based performaf^ce level. Orientation to the system will not be 
considered complete until the performance standard^ are met by the Consortium staff and the techni- 
cal Coordinators. 



Sub- Activity III-2-Determinine Decision Criteria 

The Board of Directors and the staff of V-TECS w\ll develop the decision criteria to be used 
in the determination of tasjcsto be converted to perforniance objectives for cataloging. The decisions 
will be based upon cut off indices of time-spent, difficultV, criticality, and task perishability. Other 
bases for decision criteria may be developed by the Boara^of Directore based upon research of the data 
resulting frcn the surveys of the incumbent workers and their immediate supervisors. 
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Sub-Activity II^3-Interpretation of Task Analysis Data 

An intensive training plan will guide the preparation of Consortium staff and personnel within 
the sUtes to effectively utilize the data from the task analysis system. This training will assist person- 
nel m the determination of index measures of task» which are sufficiently high to use in a cattlog. 
Optimum index rating scores will be developed when experience demonstrates that such a rating is 
feasible. Any tasks which fall below the desired index rating or combination of indice ratings will 
be excluded from conver^on to performance objectives. Continuous training will be conducted for 
personnel as the task analysis system develops and the analysis of the research indicates a need for 
further training. 

Sub-Activity IIM-Developing Skills in Writing Performance Objectives 

Workshops, seminars, and conferences will focus on the development of skills needed to wriJe 
performance objectives. Consortium staff and technical coordinators will be expected todemonitrate 
their ability to take a given set of task statements and data, then develop written performance objec- 
tives and criterion-referenced test items. 

Sub-Activity 111-5 Writing of Criterion-Referenced Test Items 

Following the training of the staff and technical coordinators in the skills of writing performance 
objectives from task analysis data and task statements, intensive efforts will be introduced to develop 
companion criterion-referenced test item(s) for each performance objective. A task statement will 
yield one or more performance objectives and a performance objective will yield one or more 
criterion-referenced test items. Criterion-referenced test writing experts will serve as consultants for 
training Consortium staff and state technical coordinators. Personnel will either be sent to the source 
of technical expertise or the experts will be assembled in conference, seminar, or workshop settings. 

Sub- Activity IIL6- Monitoring and Quality Control of Personnel, Education, and Training 

The Consortium staff and state technical coordinators will develop individual plans of technical 
prepdration for themselves under guidelines developed by the Board of Directors of V-TECS. These 
plans would serve as a guide to insure minimum competence levels of personnel of the Consortium 
:itaff and within the states. The Executive Director of the Consortium has the ultimate responsibility 
for monitoring individual training programs of the Consortium staff and state technical coordinators 
in the SUtes. The B<»^H of Directors will receive at least a biennial status report of the technical prep- 
atation activities designed for individual Consortium staff and technical coordinators within the states. 
Reports of this nature may be requested any time the Board of Directors desires to know the status of 
the total plan or individual prrogress of personnel. 



Activity Number IV 
Domain Study for Catalog Development 

The domain study consists of thorough and organized research of what has been developed in 
perlormance ob^:* lives and criterion*referenced measures which might be appropriate and helpful 
during the development of a catalog. A domain consists of a broad instructional area (such as auto- 
motive mechanics) and should include appropriate job titles (e.g., automotive tune-up mechanic, ser- 
vice station mechanic, servcie station attendent, front end and brake mechanic, general automotive 
mechanic). Activity IV consists of at least four sub-activities: 
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Sub- Activity IV-l-StaU^oMhe>Art Study 



This acti\it\ increases the probability that Consortium projects will find matijrial which has al- 
read> been partiallv or fulK developed b\ others in a domain area. The state-of-the-art study will 
include the folluwinc research activities as a part of the states' development of catalogs. 

( 1 ) a search of the ERIC syslem for germane information 

|2) a search of the journal index of ERIC for germane articles 

1 3) inquiries to the L\S, Office of Education, National Center for Curriculum Development in 
Occupational Education 

(4) selected inquiries to state departments of education for germane material 

(5) inquiries to industry and private training institutions 

(6) review of the Dissertation Abstract International Index 

(7) inquirs to local education agencies identified as working on germane projects 

Sub-Activity IV-2 Task List Development 

A cunipreheasive list of tasks performed b\ the incumbent worker will be developed as a part 
of the domain stud>. The t isk list will be based upon research completed in the state-of-the-art study 
(Sub-Activity IV- H and, in addition, will include the following: 

(1 ) a job structure ananged from the lowest job titles to the highest job title within a domain 

(2) a coding s> tern developc*d by the Consortium and identified in the Dictionary of Occupa- 
tional Titles will be applied to the job structure 

1 3) development of a task list using the following sources for obtaining task statements. 

(a) review and observation of technical procedures used by workers 

(b) identification of existing task lists or statements from technical manuals and germane 
literature 

(c \ interviews wuth incumbent workers and their immediate supervisors 
(d ) use of craft committees and M»lected committees of instructors to identify incumbent 
worker tasks 

|e) provision of space for a survev of incumbent workers to add task statements not in- 
cluded on the list 

Sub-Activity IV-3 Development of Background Information 

This part of the domain study will be used in conjunction with the task list to provide data which 
may be cross-tabulated and studied with the companion task lists. The background information sec- 
tion will include as a minimum: 

(1 ) information about the incumbent worker and/or supervisor 

(a) nime and address of incumbent worker 

(b) date survey completed by incumbent worker 

(c) job title or classification 

(d ) years and months of experience in career field 

(e) years and months of experience in present job title or classification 

(f ) pre^ ocational-technical training 

(g) private or public school attendance 

f h) highest grade level completed or GED equivalent 

(2) information about job satisfaction 

(3) information about utilization of talents and prior training 
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(4) list of equipment and tools used in the jobs of the domain 

(5) type of work environment of the incumbent worker 

(6) size of business or industry 

Sub-Activity IV4 Reports of tha Domain Study 

The following reports wi!i be required of the domain study activity: 

(1) State of-t he- Art Study-This report includes the methods used to meet the requirements of 
Sub-Activity IV4. (1). (2). and (3) of the model. 

(2) Background Information and Task List--This report includes a comprehsnive section on 
background daU to be completed by all incumbent workers who are surveyed. Following 
this section will be a comprehensive task listing which each incumbent worker will be aiked 
to verify in his job classifkation. He wiU.also be given the opportunity to add any talk be 
is performing which is not included. The background information and task lists will be 
printed, in booklet form, in a standard format set by the Consortium staff and approved by 
the Board of Directors. 



Activity Number V 
Development and Implementation of the 
Domain Sampling Technique for the Task Statement Survey 

The purpose of this activity is to obtain a sample of incumbent workers by a domain area and 
collect certain information from those sampled to be used later in a task analysis. Survey booklets of 
task statements are developed and printed using a standard format for the background and task state- 
ment mformation. The sampling design would be developed by an independent agency. This activity 
IS divided into three sub-activities dealing with the sample design, sample administration, and process- 
mg of the survey results. Alternative procedures are included as a part of Sub-Activity V-1 and Sub- 
Activity V-2. 

Sub-Activity Design of the Sample 

(1) Optimum sample design- The optimum sample design consists of administratk)n of the task 
statement survey to stratified random sampling of incumbent workers holding a job classi- 
fied within the domain. The base data to be used in determining the sampte size will be the 
occupational information (coded from the Dictionary of Occupational Titles) collected 
during the 1970 Census of the United States. The body of the information collected will be 
statistically analyzed with inferences made to the population. (All workers in the United 
States in a given job classification within a specific domain.) 

(2) Alternative sample design No. 1-The alternative sample design No. 1 collects inforn^ation 
using the same base data as in V-1 (a) but limits the sample to the member states of t'*o 
Consortium and makes no inferences beyond those states not included in the sunrey. 

(3) Alternative sample design No. 2-The alternative sample design No. 2 collects information 
using the same base data as in V-l (a) but limits the sample to the state which is developing 

a task survey in a particular domain. A purposive sample could be used by any state desiring 
to validate task lists within a state not included in the survey. 
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Sub%Vtivit> V 2 Athi ui iis t njti^ the Oci'iipatmnal Analysis Survey 

( 1 ) Optimuin admiiu>lrj{ lun ^ The optimum administration of the survey would be conducted 
thnnmh a < uitral" stall in the Consc^iitium uffite. This would permit control of the follow- 
up kttefb, fi»IlMA up tulophime tails, and generid .sequence timing uf the surveyi.. Limita- 
, lunxs exi^t in \hv apfiliiaUon uf the optimum cidministratiun which are proportionate to the 
activirie.s selected m Sub- Activity V-1 . 

r2) AUernale adn.im tratiun An tilternative method of adminibtration would be to have each 
slati' '.vhu h li'selops the ta>k stulemenl libt also conduct the sur 'ey of incumbent workers 
bahttl up«»n 'ht; v It i turn of the sample design in Sub-Activity V-1, This method is based 
upon J tht i icK d»'vel«»pment of a samplinj* administration criteria which will be used in 
the sur\t > ♦.fl<irl^. A sub sample will be select4.d and individually interviewed on the work 
site ti> compare w ith the results of the mail-uut survey. 

Sub'Artivit\ V 3 Pfoi essmi; the Survey Results 

The resiiltstif the Mirvev \mII be ke>puni.hed or upliiall> scanned and computerized. Various* 
anahses \mII be ntaJe al ihv data t»i nuike dei isiuns about taoks performed b\ incupibcnt \\orkers. 
These surve) results will pr^jvide the basis for writing performance objectives and criterion-referenced 
test items. Indacs »»r tin^» Aiitnt, diffiwult\, critivalilv, and perishabilitv will provide the basis fcr 
stratigic declsinn r:*akinu. The anaI>siN will be accomplished b> using computer prcgrams designei' !j\ 
the U.S. Air Force for this purpoa*. 



Activity Number VI 
( )i i upational Analysis Syytom 

The batkbuiu* at the F'hase II Model is the system used to develop scientific task analysis infor- 
mation based upon a dirn.1 >iur\e\ of incumbent workers. This effort should affect the quality, real- 
ism, and scope of the ^ atalogs of performance objectives. The basic source document for the task 
anal>'S!S system is the task statement survey and background information collected from the incum- 
bent Worker. Activit> Number VI has five basic sub-activities which make up the system of task 
analysis. These sub-activities have to do with computed indices of task time-sj>ent, task difficulty, 
task criticality. task perishability, and computer analysis and reporting. 

Sub-Activity VI- 1 Task Time^pent Index 

The incumbent workers complete the backgrr-^und information and check the tasks they actually 
perforrti in the task statement booklet. After checking the task statement, the incumbent worker 
rAtes the relative amount of time spent on the task along a seven-point scale. The response on the 
scale is converted to a lime-spent index hcised on percentages over the total group of task statements 
checked. The resulting, perce.itage figure is cumulative to 100 percent on all tasks checked. This con- 
version of informatifm and calculations is accomplished by use of a computer. 

Sub>Activity VI-2 Task Criticality Index 

The incumbent worker rates a task in terms of its tritital performance. The primary interest of 
this part of the t^sk aiulvsis is to «iscertain b> use of a seven-point scale the relative critical values of 
each task. When obtained, the index of triticalitv can be applied to the development of performance 
objectives. A thtir^ugh review of this critical index will identify the tasks which are most critical in 
descending order to tho>K.* which arc considered least critical- On the basis of these data, determina- 
tion can be made regarding the cfjnsequences of a poor performance of the critical tasks. 
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Sub-Activity VI-2-Task Criticality Index 



The incumbent worker rates a task in terms of iU critical performance. The primary interMt of 
this part of the task analysis is to ascertain by use of a seven-point scale the relative critical values of 
each task. When obtained, the index of criticality can be applied to the development of ptrformance 
objectives. A thorough reyiew of this critical index will identify the tasks which are most critical in 
descending order to those which are considered least critical. On the basis of these data, determina- 
tion can be made regarding the consequences of a poor performance of the critical tasks. 

Sub-Activity VI-3-Task Difficulty Index 

The same process is used to calculate an index of task difficulty which is used in the determina- 
tion of the time-spent index. A seven-point scale is again employed to determine the incumbent work- 
er s perception of task difficulty. One additional step is included to determine the task difficulty 
index. The task statement survey is also administered to the immediate supervisor of the incumbent 
worker. The respones are then correlated, .and the resulting figure becomes tbe difficulty index. 

Sub- Activity VI-4-Task Perishability Index 

The same sampling technique and incumbent workers are used to obtain a perishability index. 
This index is a me^ure, on a seven-point scale, of the relative perishability of a task statement cur- 
rently being performed by the incumbent workers participating in the survey. This in'Jex will relate 
to the need for retraining or refresher courses should the worker not perform on a continuous basts, 
those tasks which are rated to have high indices of perishability. One implication of this.type of index 
IS to provide guidance for development of self-paced instructional packages which have as a basis the 
tasks which have the higher perishability indices. Retraining and development of materials could be 
minimized by including objectives for tasks which have high indices of perishability. 

Sub-Activi.ty VI-5 ProcessinK of Data and Development of Reports 

The informauon collected from Sub-Activity VI-1. VI-2, VI-3, and VI4 will be computerized 
for statistical analysis. Information will be translated from qufilitative data to quantitative daU. The 
quantitative data will produce the index values of time spent, criticality, difficulty, and perishability. 
Many other statistical analyses can he applied to the data for the purpose oi rank ordering, multiple 
regression analyses, cross tabulation of ta^ks with elements and sub-elemerts of the background in- 
formation, etc." The resulting printouts will be furnished to the state deve'.oping the catalog of per- 
formance objecuves and criterion-referenced measures as a basis for their developmental activities and 
decision niahint;. 



Activity Number VII 
Development of Catsilog^ of Performance Objectives 
and Criterion-Referenced Measures 

The activities nriur tu Aclivit> VU have emphasized primarily thf training and preparation of per- 
soimd, the collection and an.ilyhis of information, and other preliml .ary steps necessary to write and 
catalog performance objectives and criterion-referenced measures. This activity is the application state 
.if the model. Information from incumbent workers is combined with the knowledge of selected in- 
structors, curriculum specialists, criterion-referenced test designers, and educational researchers to 
transpose the resulting data into meaningful te^t items. Activity VII contains four sub-activities de- 
signed to accomplish this task which are as follows: 
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Sub-Activity VIM Selection and Preparation of the Writing Teams 

( 1 ) Selection of Writing Teams- The project director and technical coordinator screen possible 
>^riting team candidates and select those instructional personnel which they determine have 
the potential and interest to write performance objectives and criterton*referenced measures. 
The writing team will consist of a minimum of one instructor, one technical writer, one per- 
i>on h ving demonstrated ability and experience in developing criterion-referenced measures 
and one person having either local or state supervisory responsibility over the domain betng 
developed. Each writing team should have a preferred alternate member who Kas responsi- 
bility in curriculum development at the local or state level. Exceptions to the writing team 
composition will be made upon requst by the state developing the catalog. The request will 
be transmitted to the Board of Directors with appropriate justification for the exceptions. 
Decisions will rest with the Bgard of Directors. 

(2 J Preparation of Writing Teams- The state technical coordinator will have the primary respon- 
Mbilit> uf assisting the project director in the training of the writing team members. The to- . 
^ J. design of the model will be explainedHthe resulu of the state-of4he-art study, the task 
an<il> sis system, and the conversion process from task statements to performance objectives. 
Companion criterion-referenced measures will be prepared for each performance objective 
incorporating performance standards which are used on the job when these standards are 
a^tiilable. Components of the training program developed for the Consortium and state 
technical coordinators will be used as the baius for training and preparing the writing teams 
for their tasks. 

Sub- Activity VII-2-Writing Performance Objectives 

All performance objectives developed by the writing teams will meet the definitions and quality 
criteria set forth in the Nfemorandum of Agreement. The components of the performance objective 
will contain the following requirements: situation confronting the learner, action required of the 
learner r object on which learner is to operate, limits of performance, measurability of the action, com- 
municability of the objective, and degree of proficiency required of the learner. 

Sub-Activity VII-3 Preparing Criterion-Referenced Measures ^ 

Each performance (Objective will have one or more companion criterion-referenced test item^ to 
be ixsdd by instructional personnel. The test items will be studied to insure that a definite relationship 
exists between the criterion*referenced item and the standard of performance stated in the perform- 
ance objective. The definition and components of an acceptable criterion*referenccd measure are 
spelled out in the Memorandum of Agreement and will include: congruence with the performance ob- 
jective, comprehensibility (expressed at a proper reading level for the level of the training program), 
objectivity of the test item, integrity expressed in terms of sufficient evidence that the learner can per- 
form the corresponding objective, and equivalence within the test items. The criterion -referenced test 
items will be developed by the writing teams which develop the performance objectives under the 
technical direction of the person on the team with test item experience, the director of the project, 
the technical coordinator in the state, and the technical specialist on the Consortium staff. Particular 
emphasis would be placed upon explicit information concerning criterion of performance on-the*job 
* and conditions under which performance occurs. Standards would be based upon those used b> busi 
ness and industrial workers. 

Sub- Activity VII-4— I>eveloping the Catalog of Performance Objectives and 
Criterion-Referenced Measures 

The performance objectives and criterion-referenced measures will be coded b> jub claiksificatiun 
within the domain being developed. This cixiing system will be developed by the Consortium and 
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applied to all products of the Consortium. Catalog format and content are outlined in detail and ait 
available through the technical coordinator in each state. All catalogs will be furnished in final draft 
form (camera ready) for mass production. 

Activity Number VIII* 
Field Testing and Commonality Study j 

This activity is designed to determine the instructional acceptability of the ptrformanct ob)tc- 
tives and chterion-referehced measures. The degree of validity will be detennined by analysis of 
teacher and instructor responses to questions during the field test portion of each project. Field test 
sites and conditions will be select^ed by the applicatbn of a criterion developed by the Board of Direc- 
tors, Consortium staff, and technical coordinators.. Activity VIII tonsists of four sub-activities as 
follows: 

Sub»Activity VIIM-Field Testing Design 

The field test is designed to control the variables under which the catalop will be tried by teach- 
ers and instructors. Controls are placed upon the selection of the site of field testing* supervisory and 
administrative support and interest, instructor cr teacher interest and ability, type of facilities and 
equipment, and level of students (junior high schools, secondary, post-secondary, etc.) The primary 
emphasis is placed upon determining comprehensibility, utility, and approptiateness for instruction as 
perceived by the teachers and instructors. Constraints which prevent the use of a given performance ^ 
objective and companion criterion-referenced measures are identified by the instructional personnel. 

Sub-Activity Vni-2- Commonality Review 

During the field lest, several reviews of performance objectives are made by teachers and iiutruc-' 
tors for the purpose of identifying the conomon performance objectives across a wide group of occupa- 
tional education programs. This commonality stuuy identifies those common performance objectives 
within the catalog which are appticable in^verai occupational domains. The common core identified 
IS analyzed for implications for curriculum design in general shop^ pre-vpcational, and comprehensive 
career education programs. . 

Sub-Activity VIII-3— Evaluation of Criterion-Referenced Test Items 

A jury including an incumbent worker, a criterion -referenced test item v^riter, an instructor in the 
catalog domain area, and a supervisor of the incumbent workers represented would be used to make a 
final review of the criterion-referenced test items. The primary purpose of this activity will be to 
reach congruence on the behavior being tested and to permit inference of competence should the 
learner meet the specified performance. 

Sub Activity VIII'4- Determination of Performance Objectives and Criterion-Referenced 
Measures Which are Applicable to Handicapped Persons 

The field test version of the catalog of performance objectives and criterion-referenced test items 
will be reviewed by a cort.mittee of persons to determine their applicability to^the training of handi- 
capped penvons. The appropriate performance objectives and criterion-referenced test item will be 
coded for each of the specifkr types of handicapped persons, i.e., partially sighted, speech defects, hard 
of hearing, crippled, and mentally retarded, etc. A special review committee for the handkapped wiU 
consist uf a curriculum developer, an instructor from the catalog domain area and a representative of 
each of the handicapped groups who has the ability to determine the training limitations of handi- 
capped persons in each group. The work of the committee will be coded and computerized for re- 
trieval for use in planning realistic training programs for the handicapped. 
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Activity Number IX 
Computerize Performance Objectives and 
Criterion -Referenced Measures 

The primar> purpose of this activity is to provide immediate response to the states* requests 
for catalogs. The computer banking of performance objectives and criterion -referenced measures 
eliminates the time-consuming and costly step of technical editing each time a catalog is revised and 
updated. Since only those objectives actually changed will be accessed from the computer, the major* 
ity remain unchanged and may be retrieved and printed in the same manner each time. Research 
capabilities, as well as many management possibilities, exist when the computer is used to do time- 
consuming calculations, compiling, and cataloging of performance objectives and criterion -referenced 
measures. This activity contains four sub-activities as follows: 



Sub- Activity IX-l^Developing Computer Bank of Performance Objectives and 
Criterion -Referenced Measures ] 

After field testing, the catalogs of performance objectives and criterion-referenced measures are 
processed and placed in a computer bank for rapid retrieval. The coding system adopted by the Con- 
sortium is the key to the retrieval system for the computerized information. The information Ls ar- 
ranged so that it may be retrieved by domain area or any coded job within a domain. A member of 
the Consortium may request the toul catalog or any of its sub-parts for use in curriculum design and 
curriculum building. Information is recorded concerning the perc.ptbns of the teachers and instruc- 
tors during the field test and commonality review. These perceptions concern the comprehensiveness* 
utility, and appropriateness of the performance objectives and criterion-referenced measures for in- 
struction. In addition, the perceptions concerning the commonality of performance objectives, across 
several programs in occupational education, are collected for analysis^ 

Sub-Activity IX-2---Research Aspects of the Computerized Performance ^ 
Objectives and Criterion-Referenced Measures 

(1) Field Test Data Information collected during the field test activity is analyzed by the com- 
puter. The purpose of this analysis is to identify those performance objectives and criterion - 
referenced measures which appear to be defective. When the defective objectives and 
measures have been identified, they are forwarded to the state which developed the cata- 
log with instructions for removing the possible defects. 

(2) Commonality Review The results of the commonality review by teachers and instructors 
form the basis for the identification of core performance objectives. This common core pro- 

^ . vides a basis for planning curriculum for pre-vocational, general shop, related subjects, and 
career education programs. These common performance objectives alto provide a frame- 
work for prerequisite skills, knowledge, and abilities needed by students to further their 
preparation for employment at a higher level. 

(3) Cross-anal\'sis Research*^ Computer programs will be utilized which cross-tabuJate and cross- 
analyze data received from teachers and mstructors with data collected from the task anal- 
ysis based upon surveys of incumbent workers and their immediate supervisors. The re- 
search implications of these data afe unlimited when incorporated into the Revision and 
Updating Activities of the model. 

Sub-Artivit\ IX'3 Management of Performance Objectives and Criterion-Referenced Measures 

The application of a code number to each performance objective, which relates it to a specific 
job classification* provides an added degree of manageability. The performance objectives will be 
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n^tneved from the computer bank by job classification, by total domain, by commonality efemtnta, 
or other mixes required for planning various training programs. The computer can be uaed to compile 
the catalog by printing out performance objectives in any desired structure within a domain. IVaining 
programs for a new or e.xpanding industry may be designed and retrieved from the computer and can 
provide those performance objectives which correlate with the job structure of the new industry. The 
resulting performance objectives provide a realistic planning base for curriculum which muit be tailor- 
made for the task at hand. Many other curriculum management advantages can be developed upon 
this computer bank of performance objectives. The cuniculum design implications are limited only 
by financial resources and human ingenuity. 

Sub'.'V tivit> lX-4 Development of Special Reports for Training the Handicapped Leai ner * 

The mformation collected from the work of the special committee for the handicapped (Sub- 
Activit> VIlI-4) Would be computerized and used as a research base for developing, planning and or- 
ganizing training programs and activities for the handicapped learner. The performances specified in 
the objectives and criterion referenced measures could be modified to pecmit hudkspped workers to 
demonstrate their ability in terms of particular job titles. Other valuable reseaKh couid be accom- 
plished by using the dau concerning the abilities of the handicapped and comparing it with back- 
ground information from the incumbent workers and their immediate supervisors. 

Activity Number X 
In-st*r\ice Education and Dissemination Plans 

Each :»tatc U5ing the materials of the Consortium will develop a comprehensive model for dis- 
>vaunatin^ the catalogs of performance objectives and criter m-referenced measures. In addition, a 
c*i.Mprehenbive in-t>enice training program must be developed which is designed to prepare both in- 
^itruUional personnel and supervisory personnel in the techniques of managing performance-baatd 
inNtruttiun. Performance-based instruction requires a thorough knowledge and new skills for teachers 
and their managers if it is to achieve the desired resulu. This activity contains sub-activities which are 
dirt*i ted toward the achievement of an acceptable degree of implementation of performance-bfised in- 
slrui'tion in the classrooms, laboratories, and shops of participating states. 

Sub- Activity X'l In-Service fur Curriculum Developers 

Specific pruurains will be planned for preparing curriculum developers conceifning the use of cata- 
l*>^s fur ur^auuuiag learning activities. These programs are to be planned jointly with Consortium 
aau" and include a comprehensive explanation of the system used to develop catalogs, the skills re- 
quired fur retrieving appropriate performance objectives and criterion-referenced measures, and the 
management strategies necessary to implement a performance-based currkulum effort in the classroom 
and laboraiur>. Strategies will also be included to provide direction in the organization and prepar- 
ation Mf learning activities. 

Sub-Ar tivity X-2" In-service Edi cation for Teachers and Supervisors 

A requirement of Coasurtium mebersliip is the development, by each state, of an in-service edu- 
*-aiiun pru^ram fur teauhers and managers of teachers who will begin to use the catalogs of perform- 
ante ubji^itives and criterion-referenced measures. The in-service program should be designed to 
instruct persunnel un the intention of the catalog, how to select performance objectives and criterion- 
reierem measures, and how to supplement their selection with curriculum materials and student 
It arnm^ atUvities. Those whu supervise, direct, ur administer programs and havi direct contact with 
the teaiher whu will be usinu the material should be trained in the management aspects of 
ptrfnrmanct-based instruction. Tho biisic rc*quirements of the in-service education plan are de- 
veloped and ur modified by the Board of Directors of V-TECS. 
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Sub-Activity Dissemination of Materials 



A dissemination outline to be developed by the Board of Directors of V-TECS should serve as 
a guide for the states. The specific methods of dissemination are left entirely to the participatinR 
states The Consortium staff will assist the sUtes as needed and will encourage the dissemination pi 
to be mtegrated with the in-scmce education plan when at all possible. This integration should in- 
sure proper preparation of the users and managers of the learriing process and, at the same time, 
provide a logical point of dissemination. 



Activity Numbe^^ * 
Revision and Updating of the Catalogs 

The rapid rate of change in a technical society mandates a better way of keeping vocational- 
technical mstructional materials up-to-date; but, more importantly, it mandates keeping them relevant 
to the needs of a modem job structure. ThU activity is desijned to maximize input from instructional 
pereonnel. craft advisory committees, and the incumbent worker so that catalogs may be revised on a 
scientific and as needed basis. This activity contain: four sub-activities which form a cvcle for revising 
and updatinj; che catalogs. The cycle will take approximately three years to complete with a decision 
to re«se and update or not to revise and update at the eighteen-month point in the cycle. 

Sub-Activity XI-l-Field Utilization Study 

Continuous field study is made regarding the catalogs of performance objective', and criterion- 
referenced measures. The purposes of the field study are to; (1) detect the defecUve performance 
objectives and criterion-referenced measure. (2) identify additional performance objectives which 
may need to be added to the caUlog when it is revised, and (3) obUin a wider participaUon in the 
developmental activities, particularly in the area of curriculum materials. 

The ffcid utilization study has two major components for achieving tlie purposes: 

( 1 ) Teacher ind Curriculum Developer Inputs-During the first year of use, the teachers and 
curriculufti developers will be asked to react to questions concerning wadAility. compre- 
hensibility. specificity, and appropriateness of performance objectives and critrtion- 
referenced measures. This information is added to the'body of daU already existing on the 
performanije objective as a result of the commonality study and the f*ld test results. 

(21 Craft Advisorj' Committee Inputs-Early in the secoiid year, the craft advisory committees 
for the programs using the material review each performance objective and respond to 
questions concerning (a) the utility of the performance objective, (b) the appropriateness 
for present job requirements, (c) the extent to which the performance objective is accom- 
p ished by entry level employees, relatively experienced employees, and experienced em- 
ployees. and (d) the relative criticality of the performance ob.t2ctive. 

Sub-A ctivity XI-2- Analysis of DaU from Field Utilization Study j 

The information collected from the field utilization study is computerized, and reports are de- 
veloDed to determine the results. Statistical analysis is applied to the daU to accomplish the purposes 
of the field utilization study. Data are compared with the resulU of Sub-Activity XI-3. survev of in- 
cumbent workers, for the purpose of deciding whether the catalog should be revised and updated or 
If It IS still sufficiently valid for continued use. 
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Sub Activity Xl'3-Conducting New Task Analysis , 

The same procedure used ia Activity VI, ta&k anal>*sis systegi, is at the twenty-fourth month 
point in the revi&ion and jipdatinti cycle. The same task statement are used with the exception that 
those added by incumbent wodke rs on the mitial survey are included for this survey applicatioa. 

Additional informatfon requested of the incumbent worker is that he add any ti:sks he is now 
domg which do not appear on the list and place an asteri^c b^* those task aitatemenu which he has 
begun to perform for the first time during the last twelve months, 

Sub-Activity XM- Decision Criteria for Revising and Updating Caulogs - 

The mformation collected on the mh task analysis is computerized and analyzed. The purpoit 
uf the analysis is to determine the extent of iiew tasks klentified by incumbent worjktis which* have 
been accomplished the first thne durinrthe immediate past tweKe months. A rtvieV of thu r«ttki 
K.t the field utilization study (Sub-Activity XI-1) and the survey of incumbent wo^en fonns the bans 
for the decision regarding the need for revision and updating of the catalogs or portions of t^^ 
logs. If the dat;^ suggesu a need for revision the catalogs are put through the same procett as for theii 
mitial development. . ^ ^ 

Activity Number XII - 
Third Pdrty Evaluation of the Vocational-Tcchi-ical 
Education Consortium of States 

Evaluation i»C the Con^iortium on a biennial boMs i:* considered de^rable by the Board of Direc- 
tors uf \ TECS. A third party ^valuator will be selected on a low.bid basis from a gtpup of compe- 
tent and qualified e\aluators. This type of a&sies^^ment has important advantages and will serve as a 
bdid^ for self renewal. Thii activit> contains three sub-activities which are as lollows. 

Sub>Activit\ XIM Selection of the Evaluetiun Team 

« 

The Board uf Directors of VTECS v^ill select a qualified low bidder as a third party evaluator 
from :»iaies ur organization^ ouuide the membership to evaluate and make recommendations concern- 
ing the total orKanization and its procedures. This evaluation shall occur within the first t yiars 
uf the operation and ever> two years thereafter. The Board uf Directors selects and employs the 
evaiuators and sets guidelines for their study. These guidelines will be used as a basis for developing 
d well-defined and congruent request fur proposals. 

* " 
Sub- Activity XII-2-The Evaluation and Report uf Results ' 

The evaluation is conducted b> a teoin sekcted by the Board of Directors. The chairman of the 
evaluation team will be elected by the successful bidder and the mc^mbers of the evaluation team. 
The results of vhe evaluation are forwarded to the Chairman of the Board of Directors of V-TECS 
v^uh a iopv transmitte^d concurrent^ to the Director of the Southern Association of Colleges and 
SihooU the Executivu Secretary of ihe Cummisjiion on Occupational Education Institutions, and 
the Exeiutive Director uf V-TECS. . - . 

Sub>At tivity XII 3 Implementation of the Rr^commendatjons of the Evaluation 

> 

The Board of Directory of V TECS review.s the evaluation results and direct* tht implementation 
of tht recommended chan^is as it deem:;* necessary and expedient. The administering agency files its 
a'bpon^se to the. B<^>ard of Directors for consideration piior to implementation of rerummendations 
made by the evaluation team 
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GLOSSARY OF TERMS 

J . ■ 

1 Caulon A collection of perfurnunce objectives and companion criterion-referenced test items 
oi^anued by domain area and further broken down by job titles within the domain. 

2. C ritenon^Referenced Test Exercise ^ A critenon referenced test exercise is u exercise based 
upon a performance objective and is designed to allow the determination of whether or not the 
* learner has accomplished ;he objective. It possess each of the characteristics specified below: 

a. C<:ngrui;ncc' - The task specified in the item corresponds directly to the per- 

formance specified in the objective, including the situauon. 
action, ol^t, and limits. 

b Comprehensibilii V The item-specified task is so stated or portrayi&d that the learner 

cUkriy understands wh A is expected of him. 



The exercise (includinc component items^ if any) is stated in such 
a way that all competent obaerveis (evaluators) can make a clear 
and equivocal decision as to whether or not the learner has demori- 
strated an acceptable performance. 

The exercise is structured in s^ch a way that an acceptable re^ 
sponse to the ea^rcise tonsMtutes sufficient evidence, in and of 
Itself that the li^amcr ha^^ accomplished the conesponding ob* 
jective. 

If two or more exerc^ correspond to a single obH^ctive, each 
exercise in ^ set would be a irut altematei in that a student 
who pastHtor fails) one exercise on a fiv^n occtfion would be 
expected to pass (or fail) any other exwise in the set 

3. Domam - A group of job titles which are closely related according to Vocational Educciion and 
Occuoationt, U.S. Department of Health, Education, and Welfare and U.S. Department of Labor, 
U.S. Government Printing Office, 1969. 

4. Donain of Intertst - T^te total content covered by a subject or occupation. Domatn charts, as 
they become a part of a task analy-sis, provide the limits within which the performance objective 
and criterion-refeienced test exercises are developed. 

5. Incumbent Worker - A person who participates In the survey of woricer^ ir business and industry, 
who holds a specific job at that p?art'Icu!ar time. 

6. I ivstructionai Systen> - An intef /ated combination of resources (students. Instructors, materJah, 
equipment, and faciiiti^}, techniques, and procedures perfonpiAg efticiently the functions re- 
quirettto Khieve specified learning objectives, 

7. Instruction^ System Development A deliberate and ordcily process for pUnning and de\'elop- 
ing. instructional programs which insure that personnel are taught the knowledges, skills, and 
attitudes esential for successful job performance. This process is also known as Instructional 
System Engineering and S\ stems Approach to Training. 



c Objettmtv 



d. Integrity 



Equivalence 
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8. Job The compoate of duties ai.d tidrs actually performed by an individual. 

9. Job Inventory — A listing of a)i takJu to be performed, 

10, Job Performance Requirement Staudar H - The tasks required of the human con^ponent of 
a System, including the associate J standard'of performance. 

11, Occupational Analysis — Tlie process of identifying duties and tasks which comprise worker*' 
responsibilities, including the collection, collation, and analysis of such dat^. 

12, Performance Obiective - A pe ' jmance objective is a statement in precise, measurable terms of 
a particular behavior to be exhib.ted by the learner under specified conditions. It possesjies each 
of the elements Ok character! "s specified below: 



a. Situation 

b. Actio*! 

c. Object 

d. Limits 



The situation confronting the learner is clearly specified, including 
the mode in whith stimuli are to be presented. 

The action required of the learner is unambigousl'^ defined, includ- 
ing the mode in which responses &re to be made. 

The object on which the learner is to operate (i.e., the object ot 
the action) is clearly stated. 

The particular limits associated with the activity expected of the 
learner are specified. (Limits may be placed on situation, action 
and/or object.) 

The specified action is an observable rather than an inferred re- 
sponse. 

The objective is so stated that one, and only one, interpretation of 
the objective is. reasonably pciidMe. 

The degree ol rxficiency required as evidence of accomplishment 
by a student of the objective is indicated. (The criterion may be 
indicated implicitly or explicitly. If implicit, 100 percent accu- 
racy is effectively designated. If explicit, it may be appended 
parenthetically to the statement of the objective.) 

1-5- Duty A dii>linct grouping of tasks which are related to each other by th-. nature of the work to 
be periormed. 

li, Tdsk A unit of work activit> or operation tha^ constitutes logical and necessary step in the 
performance oi a duty. 



Measurabilit> 

Communicabilit> 

Criterion 



15. Taak Analysis The process of dncil> zing job invent^.y data sc» as tu determine trainin-r require- 
ments. 
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Introduction 

Job task inventory questionnaires seemed especially appropriate for analyzing Bell System jobs 
because the method was specifically developed and has been used successfully to analyze jobs per* 
formed by many widely dispersed job incumbent.^. 

In the BeP System, several groups analyze jobs for a variety of reasons, and Western Electric even 
offers a course ..n how to study jobs using the job inventory method. Our work differs from most 
other job analytic work in our company in that our work is research and development oriented and 
multi-purposed. 

. We view job task analysis as a potential central component in an ongoing personnel management 
syitem, rather than as a method liftiited to a single objective or application. Our plan is to preserve 
the data collection instruments, the data, and the analvMc procedures so that unanticipated questions 
about jobs that crop up can be answered, or periodic updates of the data can be managed at a fraction 
of the original cost. 

t 

There are, as we have seen here, man: approaches to job task analysis and the documentation of 
the retulti. What most met'wods seem to have in common is a comprehensive list of tasks that com- 
prise the joh activities. The differences between the methods appear to be mainly in format and in the 
kind and amount of auxiliary data-such as *ask importance, task difficulty, task time, etc.— requested 
about task^. 

What I will discuss today is oor approach to developing job task inventories, and how we have 
^ uaed them in thre^ projects. The fjrst two projects had specific, nanow objectives by comparison to 
' the third project, which, by the way, is still in progress. 



Task Inventory Development 

Our first step in the process is to compile a basic task list that describes the work activities and 
will serve as a focal poini for the analyses to follow. We develop knowledge and task statements al- 
most exclusively through int^rvi^ws. Sources of job information, such as job descriptions and train^ 
ing materials, when they are available, are studied to help understand the job and prepare for the 
interviews. 



Permission to reprint this speech has been granted by American Telephone & Telegraoh Company* 
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The step after knowledge and task statements are derived is to develop data collection instru- 
ments. We cast knowledge ^nd task statements, as I ^ ill show, in a questionnaire that asks respon- 
dents questions about each task, such is: 

Do you perform this iasfe in your work? 
How often? 

How important is this task in your work? 
How difficult is this t^sk? 

How much time do you spend performing this task? 
How well do you perform thu^ task? 

Naturally, we define our terms and provide instructions on how to use the numerical scales that 
determine the responses. As you might suspect, we also request that each respondent provide conven- 
tional, biographical information so that we can cross tabulate the data in a number of ways. Wt have 
not included every one of the above questions in each inventory we have administered. Though we 
have not yet done it, we have considered preparing different versions of a job inventory questionnaire, 
and administering them to different subsets of job incumbents so that we can obtain the information 
desired without overburdening the respondents.. 



Job Task Inventory Interviews ^ 

The purpose uf the interviews is tu determine vaiuI incumbents have to know to accomplish their 
\fturk and what they actually do. We have used experienced interviewers who are familiarized with the 
]ub task invenLor> method and the expected interview results. The interviewees are usually immediate 
^supervisors with current, detailed job knowledge, though, in some cases, job incumbents have been 
interviewed. 

Tne intervievNet5 are requested tu bring to the interview samples of all the materials dealt with by 
iht* jub incumbents, for e.\ample, forms, sketches, blueprints, references, job practices, etc. The ma- 
uriaL i^rvt tu generate discussion of things that initiate work, and of what is accomplished. We have 
il^u found that work site visits both before and after the initial interview help to understand the work 
flow and the work environment, and can clarify some interview result?. 

Essentially, three separate interviews are conducted to arrive at the knowledge and taik state- 
mtnti» that \%ill be included in the jub task inventory. We refer to them as the initial interview, the 
veritication interview, and the follow-up interview. 



Initial Interview 

The initial interview !:> used tu obtain the bulk of the job information from which the task state- 
ments vsil! be extracted. The interview starts by covering some genexel topics such as how the job re- 
lates tu other jub^ ur huw the department in which the job is performed relates to other parts of the 
cumpan>. ;\s the interview progresses, it becumes more and niore specific, focusing on input and out- 
put reliitcd activities. Questiuning on what dune with inputs and outputs continues until the inter- 
viewee is satisfied that ail have been covered. 

laterviewi* rarely pru^jress neatly. Interviewees tend to jump around referring to material previ- 
♦Uijly cuvtred in urder tu ubbuiate on activities ur tu udd sume activities previousl> forgotten. They 
til^i ttnd t<i move back and forth between i>p*jtific details and general kinds of information. It is there- 
lure nvcesiHirN to take notes durinu *nc interview.. Written notes are very usf^ful fur identil^'ing unclear 
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topics that can be returned to at a later point in the interview, and the notes are helpful in preparing 
fur the verification interview. Further, nc ^e taking indicates to tK? interviewee that attention is being 
devoted to the material covered. 

Wc have supplemented written notes by tape recording the interviews. The tape recordings allow 
independent derivations of task inventor>' statements for comparison purposes, and, of course, the 
tapes can bo replayed as many times as is desired to clarify particular points. 



Verification Interview 

The verification interview, conducted with a different interviewer, follows the same pattern. 
The purpose of the verification interview is primaril; to check and modify information already ob- 
uined and to cover aspects of the worK that may have beenbneglected in the initial interview. 

The interviewer should prepare for the verification interview by reviewing notes taken during the 
initial interview. Tentative statements for the job task inventor>* may be drafted and tried out in the 
verification interview, and certainly, any items that are not clear should be covered. 



Extracting Task Statements 

The same general to specific approach used to conduct the interviews can be used to extract 
knowledge and task statements from the interview material. General information about interactions 
with others, coordinations required, etc., can be reviewed first. Then the physical aspects of the job 
can be studied. Next, attention can turn to the input stimuli that initiate tadcs. Once task statements 
are written concerning the indicators to the employee for what has to be done, job performance aids, 
such as reference materials, can be considered. Finally, the ways that the input stimuli and the refer- 
ence materials are manipulated to develop products are considered. 



Follow-Up Interview 

The follow-up interview is conducted with the same employees who participated in the previous 
interviews. The interview is aimed at reviewing a draft of the job task inventory questionnaire. The 
purpooe of the job study is explained and the job task inventory method described. The directions 
and each statement in the inventory questionnaire are reviewed aloud and are rephrased as indicated 
during the discussion. Interviewees are encouraged to be critical of the knowledge and task state- 
ments. 

When the directions for completing the inventory and all the statements have been covered in this 
manner, the interviewees are asked to check the list of statements fur duplicates and omissions. We 
have also tried the draft job task inventor>' questionnaire out on a few job incumbents as part of the 
follow-up procedure. 

Modifications, such as those below, are the kinds that can be expected. 

The draft statement, ''Check arithmetic on vouchers," was revised to read"Check arithmetic on 
vouchers and bills." 

The draft statement, '*Solve problems when the system is hung up,'' was revised to read, "Ana- 
lyze machine stops." 
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Engineering Project 



The fundamental purpose of the job analysis in the first of the three applications of the job task 
in\entor>' I will dL<cuss was to determine the qualifications required for three entr>' level engineering 
job^.* Once qualifications wert clearly established, it would be possible, among other things, to design 
and validate improved selection procedures. 



The Inventories 

The job inventor) questionnaires f hat v ere developed consisted of several sections. In the first 
Miction, the job incumbent provided biographical information. In the next section the engineers rated 
various ac^J^^mic and company training courses in terms of their relevance to the work they per- 
formed, ^k^ute 1 contains a sample from one of the questionnaires; the other engineering task inven- 
tories included the same section. 

Figure 2 contains a sample from the Outside Plant Engineer Questionnaire in which the engineers 
rated the importance of various kinds of knowledge to their jobs and then identified the sources from 
which the knowledge was obtained. For each item of knowledge rated as important, the respondents 
distributed 100 points to indicate to what degree each of eight possible sources contributed to their 
knowledge of that particular item. 

FigAire 3 contains a sample from one of the job task inventory questionnaires in which the engi- 
nters raU'd the importance of each task they performed, their ability to perform it, and where they 
karned to do it. Here too, for each task rated as important, the respondents distributed 100 points 
among a number of possible sources to indicate where they learned to perform the task. 

Only a few of the job task analysis results can be covered here. 



hngiaeerirg Study Results 

Some differences were found among the jobs with respect to the relative amounts of time spent 
un variuUh work functions or ijroups of tasks with similar work content. The COE engineers devote 
abuut a quarter of their time to ''Monitoring** or follow-up activity, but almost no time at all to 
Designing,** whereas the OSP engineeii, by contrast, are light on '^Monitoring'* and devote about 39 
percent of their time to "Designing." 

Academic or company courses, from the first part of the Job Inventory Questionnaire, that 
proved tu bt the most important were Arithemetic, Basic Electricity, and Basic Electronics. The 
i.uixtM:^ rated least important for the three entr>' level engineering jobs were Calculus and Statistics. 

The wa> thai the incumbents distributed points across the sources of their job knowledge showed 
lhal ihe> derived Tl'^ of the knowledge they needed to perform their work on their present job. Simi- 
Iarl> , the engineers reported that the source of 80 percent of their job skills was their present job. The 
R-^ults c imcerning sources of knowledge and skill for the three engineering positions reinforced the 
philuciuphv that job qualification standards calling for prior experience or education should be stated 
iti vtr> specific terms which indicate. how the experience or education is related to ability to do the 
job 



*The J vibs studied are but a few <*f the telephone companv engineering jobs, some of which are highly 
specialised, and the information presented herein pertains onl> to the three jobs studied. 

8 / 



90 



PART I 



FORMAI. FnurATION AND TRAINING 



ACADEMIC COURSFS 



1. .irichmettc 

thi»orv 

m»?nCal > 
phy*5lcs 
^. prlncipli's .>t* .iccountin>: 
in. nfchanicil drawing 
hislc ilectrintv 




PLANT TRAINING COURSES (Continued) 
(Central Office) 

22. Switchboards 

2 3. Stcp-hy-Stcp Svitchinv* Svuer 

24. Panel SwicchinR Systt^n 

^^.^ 25. »'l X-Bar 

^ 26'. 4A Toll Switching Sv.tt-n 

2 7. X-Bar 

28. X-Bar Tandem Sunt chine i^vmor 

29. ESS 

30. 'MOl ESS 

31. f'2 3 Type Desks 

32. Central Office Frare 

33. Line Concentrators 



Ralevanca Rating 



3 - Taking this course is necessary background to do my job. 

2 - Helpful, but a perscn could do my job without having taken 
luch a course. 

I - Not appropriate to my work. 

6 - Not familiar with course content and can't evaluate It. 



Figure 1. Academic and company training courses 
included in each engineering job task 
inventory. 
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PAFT II 
KIJ0WLED3K STAlErtzl.r: 
WTSIDE PLANT EN^riEF. 
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MY JOB P£iVIR£S A!! Vr^DERSrAIiDD? # OF: 

1. *Ch»it to look for when taking field notes for aeriO 

faciUtU^ 

2. Construction re'^ults plan inforn.iti<>n to put on 

construction w^rk prints 



1. 

7. 



N*ew design developments m Oi>P 

Design orlnclples^ot nultlple planr 

The usage of range extenders 

Bell 5;vstem temioologv, including svr.hol 




Importance Rating 



U - A thorough and detailed knowlt-drze of this ic requirt^d to do m:/ job. 

3 - Sone degree of cpeciaiised knowled^*e is required. 

2 - Only a general knowledf:e of functions or int»/rr''lv.i<ln:; p^quirtrd. 

1 - Some familiarity is probably de;:irable but no^ rHq»ilr»joi. 

0 - This ic not required for my Job. 



100 

1)0 



Figure 2. Knowledge statement fprmat extracted from 

the Outside Plant Engineer Job Task Inventory. 
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PART III 
TASK STATEMENT 
PBX ENGINEER 



MY JOB REQUIRES THAT I 
l# Read wiring diagrams »T Drawings) 
2. CompK^te >;ri*t?n shpi»t properly 
J. Estimate floor area l^^adings 

Estimate tvpes jnd amounts of equipment 
required m i new PBX 

5. Estimate pnx equipment layouts in terms 
of ffiture i^quipnent tidditions 



SOURCE(S) OF YOUR CAPABILITY 



§ I § 



X 

o 

X 



X 

ui , O 




Ul 

o: 
O 

u 

Ul X 

_i 



Cl 



Ul 

u 



O 

Z 
ut 
U 



K 
CD 



flD 
O 

> 
Ul 

oc 

C 

Ul 

z 
o 



^ - Abrolutely noc^j-r^ir-iry part of ny job 
3 - Very inr^rtant part of rx/ job 

^1 - Desirable, but n^t -ritically important that I do this 
1 - wli^'ht Lnportance whether I do this or not 
0 - :;ot a part of rx^ ,;ob 



Capability Rating 



Importance Rating 



1+ - I can do this as well as anyone 

3 - Still have sonethinf, to learn 

2 - Am fairly proficient 

1 - Below average proficiency on this 

0 - An not equipped to porfom this task 



ERiC 



Figure 3. Task statement format extracted from the 
Private Branch Exchange Engineer Job Task 
Inventory. 
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The job analysis results led to the development of a selection procedure composed of seveia) 
pencil and paper tesu, such as Arithmetic and Basic Electricity, a specially developed aneeiment.cw- 
ter procedure designed to get at aptitudes and personal qualities, and some special screening rvqutrt- 
ments, such as drive a standard shift car, travel overnij^t, etc. The pencil and paper tests and the 
assessment center procedure were included as predictors in an engineer selection procedure validation 
study. * 

Some of the Job incumbents were asked to rate their capability to accomplish the tasks in the in- 
ventory. As can be seen in Figure 4, a long time on the job seems to be required to achieve a high 
level of confidence in performing all tasks of the job. The gradualnesi of the rise m the self-appraisal 
curve suggests that there is considerable room for acceleration in the development of enpneering skills. 
If job incumbents could be brought to proficiency at the faster rate indicated here by the dashed 
carve, significant benefits would accrue from the stJtndpoints both of expense and quality of work. 
The job analysis provides a solid basis for accelerating employee development through prtpantioo of 
iub aids such as engineering handbooks, and improved training both on the job and off. 

Another wa> that the job study results were used was to develop ratmg forms that included tasks 
identified as imporunt to each of tu hree engineering jobs. Supervisors rated engineers on a task 
by task ba:k:s. and the overall ratings served as one criterion ':n the engineering selection procedure 
validation study. 



Marketing Projert 

The Mjcond project involved four salej> jobs. Th^^ purpose of the project was to develop a proced- 
ijixt for Mikctmg higher level sales personnel from among lower level sales personnel and to validate 
the ><flection procedurtf. It wai> therefore important to determine similarities and difieiences between 
the jobs, and the job task inventory method was used to study the four jobs. 

Skilled job incumbents were inUirviewed in this case. One inventor>' consisting of 128 task state- 
ments w<i^ developed, and task importance, task difficulty, and task time data were requested. District 
managers were trained to administer tiie questionnaire, which was completed by 35 Sales Managers 
iSM), 23 Account Representatives second level (AR2), 74 Account Representatives^-first level 
( ARl ), and 30 Communications Consultants (CC). 

Task iit<iienrients i^ere groui>^ into broad job dimensions such as Managing, Selling, Technical 
and Persona!, and ibx auxiliary data were analyzed in terms of the broader job dimensions. Task im- 
portance averages whon averaged by job dimensions per job are: 

• ft 





SM 


AR2 


ARl 


CC 




•■i.ZO 


i.74 


1-24 


0.82 


&lhng 


0.76 


2.83 


2.82 


2.36 


Technical 


1.50 


2.27 


2.51 


2.40 


Pmonal 


1.71 


2.67 


2.58 


245 


Mb.cf.'ilaneuUj 


0.70 


1.73 


1.70 


1.61 
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As might be expected, the Sales Managers regard Managing as much more important than do 
either of the other tiuse sales jobs. Account Reps and Communications Consultants, on the other 
hand, regard Selling as more imporUnt to their work than do the Sales Managers. 

Graphically, as m Figure 5, the differences between th^-Sales Managers' responses and thoM for 
the three other jobs is quite striking. Though the AR2. ARl and CC jobs are similar in many respects, 
they are not as much alike as the job dimension averages indicate. A breakdown of the Manapng cat«- 
Bory mto functions, as listed below, shows that the differences between the Sales Managers and the 
other three jobs hold up across the Directing, Controlling, Developing and Forecasting functions, but 
differences between the AR2, ARl and CC jobs now show up. 



iSanagmg Functiuni 


SM 


AR2 


ARl 


CC 


Directing 


2.89 


1.71 


1.02 


0.74 


Con uol ling 


3.28 


1.65 


1.39 


1.11 


D«vf loping 


3.27 


0.97 


0.60 


0.35 


ForvcastinK 


3.30 


2.38 


1.77 


1.04 



Vn fxamination uf the other dimension functions would reveal essentially the same results, but 
ihf Salt-:, Managers would have the low importance averages and the other jobs, the high averages. 

If we were to focus on usk imporunce averages per job, instead of. as we have, on job dimension 
importance average:., it would be clear that a number of Usks are uniquely important to each of the 
jnbs, with the exception of the ARl job. The job task inventory method proved quite adequate for 
de>:cribinR the jobs and identifyingiamilarities and differences between them. 

Ck'raal Pf « 'jf t 

Turnmu to the third project, a stud% uf seun clerical jobs^in our comptrollers Dttpartment. our 
-.hort ranKe objectives are: 

1 To develop a method uMny job task invenlor> data for empirically deriving job qualifi- 

ratloni.. and 

2 T. . aisess the fediibility of the job task inventory foi broad Bell System use. 

In 'hf Ion" run. we plan to assemble the materials, including the computer programs, the docu- 
nu matiua on how to use them, and a guidebook on the entire procedure, that will enable other re- 
.e.r. hers and manai't-D. to apply the job task inventory method to jobs m which they are interested. 

.\pproarh 

(Jur approach was to develop six different job ta:>k inventories to represent tht' knowledge needed 
•ifl.J the activUK's performed in the seven clerical jobs, one of the inventories covered two jobs i he 
j..b t.uik mvenlon- questionnaire. dtstributed to a field representative ac each of three telephone 
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Figure Job dimensions for four sales jobs. 
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company headquarters, and the field representative, in turn, forwarded the questionnaires, through 
mimed lale supervisors, to all job incumbents performing the job of interest in the company. The job 
in\entoo questionnmas were.completed by about 1,150 clerks working in 26 different cities. 

The jobs studit*d art^ 

Cftnsokf OperiUu - multistremn 

Console Operator - single stream 

Keypunch Operatoi 

Payroll Alottment Cierk 

Revenue Reports Clerk 

, Service Order Clerk • 
f'uurhe' Aud«t Clerk- 

The tv^o ionsiJe ♦jperator jobs were the jobs covered by the saine job taJc in^entorj , and th^ *• 
oiher nve jubs wea* covered by individual inventories. 

The data culfected v^erc analyzed per job by cump*ny, by city, and for the total sample. The 
iiiam thrust uf the anabses was to obuin *4>erjges for task importance, task difficulty Jtask time, and 
the numbe* and percentage of job incumbenU performing each task were also tabulatOT. Task import- 
ance, taJc difficult.N, and task time averages were correlated within companies to examine relationships 
telween task dinienMun^^aad between companies to examine relationships between the^sanu dimen- 

The relative impurtance and relative difficulty uf a knowledge or task statement was determined 
r V lakmg both the average and the percentage of non-zero respones into account ^ zero response 
iueant that the mcumbent did nut require* the knowledge or perform the task. Statements were classi* 
fied on the basis of whe titer the i: ratmg \*asa 3.00 or higher on the average, and v^ere performed by at 
least 50 percent of the respondents in one, two or three of the companies where the data were ob- 
tamed. The more important la^ks, then, are thobe lhat met the 3.00/50 percent criterion in all three 
♦ ompanies» , , 

A> in the preuou^ studies di:»tui»M;d, functions were formed b> grouping tasks containing similar 
u uuties or behaviors. Time estimates wea- computed for each lade by multiplying the frequency 
Aith-^^huh the task^ v^ere performed h\ the time devoted to performing the tadc just once. Total 
lime per fanttion and total time for all functions were calculated for each job By dividing the total 
uih*. iiiiu the time < altulale^ for each funition, the percentage of time devoted to each function was 
fcrnuntd. A fevv e\amfiltj^ of job functions and ^he p^- entage of time devoted to them are as fol- 

i . • 

Fi^rull Allotment^ clerks devotje alaiut 22" of their time to balancing Aiujunl.s, and nme 

^iKii oi 49 liisks were sub^iumed bv function. . 

Vuu* her Audit • lUks devuit/ about 57^^ of fhdr lime tu Chei kinu an J Comporini:, and 
1 8 im of 77 ta^st^s *Aeri^ subsumed by this funt tiun. . * 
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OnK a brief ^ummar> of what was learned from the job <inalyses than cm be covered here. 
GtneralK. task imporlanre aveiaRes tended lo b^ on the high side. Task difficulty ivemp^ welt^ 
low ip moderate, and the task difficulty averaf^s varied within a very narrow raRf;e. High expert- 
erne levels among the respondents seem to have significantly affected the ta«k difficulty averages 
and their wntatii>n. Time was mo4*e evenly spread over nrwiny of the tasks for II e jobs than for two 
fif the Jobs where only a few task^ accounted for the bulk of the ttme. 

T*^sk imp* fiance and task difficulty averages and median tadk time are highly correLUi between 
( f>mpanie*v apparfntiv the clerks* responses were consistent. Task importance is eswntiall^ uncor- 
related with ta>k diffu ult\ , and is correlated to a low degree with task time. Task difftcuity is uncor- 
re!alt*d with task time, ajiaia prubabK due to the narrow range of task difficulty averages. 

•WV are nu w m the pricess of empiricalU establishing job qualifications for the seven clerical jobs. 
t)ur approach w lu prest nt samples of immt wate supervisors of cBch of the se>*en jobs with a list of 
skills und abilities and another list of ihe importance tesks-a 3.00 or better task imporUnce average. 
.Vfter the super\isf >rs arc^amiliari^ed with the skUl and ability definitions and the procesi wre want 
:hem to > ihmuiih. we fxped them to assign scale a*aes to each task that represents the degree to 
whii h t at h skill »r abihtr, is required in perfurn: each important task. The analysis of the data should 
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METHODS FOR 
CURRICULUM CONTENT DERIVATION 



/" Frank C, Pratzner 

Harry L. Ammerman 
The Center for Vocational Education 



The r€«earch and de\relupment project on '^Methods for Curriculum Content Derivation*' is one 
of many R&D projects at The Center. The focus of the projf^ct has been on the development of guide- 
lines and procedures for systematically identifying and selecting content for occupational training pro- 
grams Content is one important element of any instructional system and we have delimited our con- 
cern to its identification and selection. We are primarily concerned withaWHAT content is learned in 
an occupational program, not with HOW that content is taught or learned. Thus, we are not produc- 
ing instructional materials nor are we directly attempting to improve instructional methods or tech- 
niques though, sui^ly, these are important and worthy areas for research and development. 

In a broad sense, the goal of the ''Methods for Curriculum Content Derivation*' project has been 
the development and application of new ways to bring the school curriculum and the realities of the 
work world closer t^ogether. We have focused our efforts on those who develop educational programs 
for work becauae they decide what job-relevant content to include in the curriculum to enable stu- 
dents to enter and succeed in work. Limited research and the prt^ponderence of existing circumstan- 
tial evidence seems to indicate that the content included and emphasized in the curriculum are factors 
more likel> to influence learning achievement than are the media, methods, or materials for teaching 
the content.* This information, while limited, leads u? to agree with the conclusion noted recently 
by John Flanagan that, 

. . .thii quality uf the present educational programs can be improved more by systematic 
selection of what is to be taught than by improving how it is taught . . . 

The area of research that has been most seriously ne^ected in the last decades has been 
the formulation of educational goals and outcomes.^ 

In vocational education and occupational training, not everything about an occupation can or 
juld be taught. Dtvelopers must be able to weed out the merely ''nice to know,'' and unessential 
content so that learning can be focused instead on the critical job skills and knowledges required by 
learners for successful occupational performance. 

Procedurts and guidelines now being developed by our research and development project are in- 
' ended to enable developers of performance-based curriculums obtain systematic and comprehensive 
descriptions of what ii done by workers from persons closest to and most knowledgeable about job 
performance. They are intended to enable developers to use these "performance analyses'' to iden- 
tify curriculum content that is timely and relevant to the performance requirements of occupations, 
and to select from the job-relevant content that content which most warrants some formal training 



Walker. D F A Schifftrtick. J. ''Comparing Curriculi/* Heinew o/^i?ei<orch, 44.83-111, Winter, 1974. 
'Flanafan, J C "Education. How and for What." Americon PSiychotofii*. 28. 551-556, July, 1973. 
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prior to the students' employment. The guidelines and procedures are expected to be of greatest 
benefit in those situations where there is uncertainty about the performance requirements of an occu- 
pation and uncertainty about the content most essential for train.ng. 

The procedures and guidelines we are developing will be available to curriculum developers in a 
set of user manuals. The manuals will contain explicit, detailed descriptions of the procedures and 
guidelines, along with illustrative materials from several occupations. Five volumes or manuals are 
planned. Volume I will be an introductory volume. Its purpose is to acquaint the potential user with 
the overall content derivation process, claifiy terminology, and describe the application of the process. 
Volume II will describe procedures for sUting the tasks of the job and will include guidelines for de- 
fining the scope of occupational training interest. Volume III will describe procedures for identifying 
relevant job performance. Included will be such things as the design of occupational surveys and task 
inventory questionnaires, and summarizing and reporting survey results. Volume IV will describe pro- 
cedures for deriving performance requirements for training. It will focus on procedures for selecting 
usks which most warrant training consideration. Volume V will be a set of technical appendices for 
processing survey data. It will Include data processing programs, programming instructions, and data 
identification coding. An annotated lut of selected program publications has also been appended. 

Those involved m the development of vocational and occupational training programs need ef- 
fective procedures to aid in the identification and selection of content with known relevance to oc- 
cupauonal performance requiremente. They need to be able to assure users of their curricula and 
instructional materials that the things to be learned in the training program are the things most appro- 
priate learned there, and that when the> use their materials, studsnts wiU be learning skilU which are 
important to and required for effectiv.e performance in the occu^tion. 

In deciding on what content to include in the curriculum of an occupational training program, 
those who develop curricula often wish to consider many factor*. Some curriculum developers want 
to consider the stresses or contingencies under which work mu'.t be perfor^ned on the job. Some are 
concerned with the generalizability of the skills to be learned and their application in new problem 
situauons. Others look for procedural requirements and performance cues that define mastery of 
specific tasks. And, still others wish to consider the essential human skills that are necessary for the 
individual s physical and emotional well-being in the fulfillment of the work. Related conceptual 
knowledge and comprehension, interpersonal interactions, requisite psychological attributes and phys- 
ical requirements, and individual feelings and interests of the students are some of the other factors 
that curriculum developers have said should be considered in deciding on the content of a curriculum. 

Regardless of the merit of considering any such factors, to consider any of them in a manner 
that IS comprehensive, systematic, accurate, and specific iftually takes considerable time knd resources. 
It would seem helpful and most efficient to be able to narrow the focus upon just those aspects of an 
occupation that most warrant such expenditure of time and resources. This narrowing of occupational 
focus IS the purpose of the methodologies which are currently being developed by our project. 

The intent is to get curriculum developers to the point where they can most efficiently investi- 
gate the paiticular factors in which they have an interest, by whatever process they use to accomplish 
that examination. 

The approach we are developing is an adaptation of the process for conducting occupational task 
surveys developed over the past 15 years by the U.S. air Force.^ Our "task inventory method" is a 



l\IoR.h. J. E.» & Archer, W. B. Procedural guide for conducting occupational surveys in the United States Air 
Research Division September 1967. (NTIS No. AD-664 036). 

Chrisial, R E, The United States Air Force occupational analysis project ( AFHRL-TR 73 75). Brooks Air 
Force Base. TX Air Force Systems Command. Occupational Research Division. January 1974 
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survey-questionnaire appruach to Job anal>sis being tested for providing performance data of use in 
deriving relevant and critical curriculum content for occupational training programs. Employing 
comprehensive listing of job tasks, knowledgeable persons are askW one or more questions about each 
task. This information is then summariiced in a manner suitable to the particular analyses that may be 
desired. 

The general notion of task listings as the basis for a wide sampling of worker responses is not 
new, having been the form of a survey of 1,845 workers on 871 activity statements for an occupa- 
tional area that was reported by Charters and Wiitley"* 50 years ago. One of their purposes at that 
time, as oun> is now, was to determine the job performance requirements for use in dtfining and justi- 
fying curricular content. Renewed interest in this form of occi^Jational surveying was sparked by 
Rupe' cis a result of his comparative study of several job Analysis methods. With the advent of widf»l> 
available computer processing for survey data, the survey process became quite feasible and included 
the capability of new and expanded possibilities for data analysis. This method is used to produce a 
comprehensive description of what is done by workers in a particular occuoation or occupational area. 
^It makes use of an empirical base of timely performance and criticalness data provided by persons 
close to the current performance of an occupation, usually workers and supervisors, representative of 
a wide scope of occupational performance situations. 

Our Task Inventor> method now consists of a number of integrated steps which assist resc*rchcr$ 
and curriculum developers to move from the definition of the training and.occupation of interest, 
through data collection and analysis, to curriculum content derivation. Elements of the process pre- 
sently include: 

1. Definition of the scope of the occupational training interest (such as the job setting, occu- 
pational area, and performance contingencies). 

2. Development of a comprehensive list of potential tasks for the job (including review for 
expression and clarity, as meaningful to working personnel). 

3. Selection of questions to be asked about each task to provide desired descriptive da^a ori 
task relevance and/or criticalness. 

4. Pretesting of instructions or new question formats. 

5. Design of a sampling plan to obtain representative task data. 

6. Preparation, printing, and distribution of the task questionnaires (including background 
items on respondents, work settings, and organizations). 

7. Administration of the questionnaires to workers and supervisors in accordance with the 
sampling design. 

8. Preparation of the questionnaire data for computer processing. 

9. Computation of .selected descriptive summaries' of response data for each task for each 
job, or for other population subgroups within a job. 

10. Preparation of a report of data obtained from the occupational survey, for sharing with 
others. 



**Charters, W W , & Whitley. L B Analym oftecretanal duttcs and traits. Baltimore. WilliiiHs^& Wilkms. 1924. 

^Rupe, J. C Research mto baste methods and techniques of Air Force Job analysis IV (AFPTRC^N 66 51). 
Lackland Air Force Base. TX. Atr Force Peraonnel and Training Reyarch Center. (ARDC), Ttaining Aids Research 
Uboratory, April 1956. (NTIS No. AD-105 552). 
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11. Completion of selected analyses of the data, depending on purposes to be served. 

12. Preparation of reports to be used for curriculum development and evaluation, 

The current program of research seeks to establish additional elements of the process by which 
ta^Jt ddU may be used efficiently in selecting critical performance training requirements, given the 
determination of what tadcs are relevant to an occupation of interest. 

The objective of the program is the development of methods for using timely, first-hand occu- 
paUunal task information to identify critical performance requirements that warrant formal training. 
In this identification process it is assumed that cost-effective, pre-employment training programs nec* 
e^sarily will not attempt io train students for all tasks performed by experienced workers in an occu- 
pdUon, but rather will assure inclusion of those learning requirements essential for employment and 
effective job peiformance. Thus, the identification of those tasks most needing training prior to em- 
ployment is necessary for planning efficient training programs. 

The basic issue of Usk selection is to identify those tasks having the greatest training criticalness, 
dnd ehminating the merely "nice-to-know" and unessential learning requirements The intent is to 
have procedures to select tasl.s in a systematic way, using data obtained from persons most closely 
associated with and knowledgeable about what is in fact required on the job. By such procedurei it 
i>hould become feasible to make curriculum content decisions which are data based and data substan- 
tiated, instead of relying solely upon a panel of advisors or the experience of individual instructors. 

Task Inventory Questionnaires are able to obtain this data base from a broad representative group 
uf directly-knowledgeable persons. Rules for processing these data are being developed and tested. 
Subsequently, these rules will be applied to task data to indicate whether each task should be selected 
ur rejected for further training consideration. The selection procedures will provide a systematic way 
tu process a large data base of task information, so it may be used more readily as an information 
source by those persons who must ultimately make the cuniculum content decisions; the rules for se- 
lecting tasks will not themselves actually make curriculum decisions. Shortly ve wlli attempt to iden- 
tify the most efficient set of effective rules and supportive data. 

For making curriculum decisions and plans, there is a real need to distinguish between that iob^ 
i <intent which is relevant to workers in the occupation and that relevan t job content wh ich is impor 
tant for pre-employment training. Comprehensive listings of potential tasks performed by workers in 
an occupation, in conjunction with data about how many workers do and should perform each task, 
help esUblish the relevance of the tasks to that job-at least for purposes of making decisions about 
training programs. Though some tasks may properly belong.to a particular occupation, there would 
seldom be a concern for pre-employment training on any task unless it would likely be performed by 
some minimum number of workers. Other information about task performance is also helpful in 
establishing a task s relevance to the job. Such information as (a) how often a worker typically does 
the task, (b) how important or significant the task is to the job assignment, and (c) the amount of time 
spent doing each task are all meaningful indicators of task relevance. These kinds of information have 
been traditional measures often used to describe the work that is pertinent to an occupation. This 
job description information is one very important determiner of what is appropriate for training, but 
certainly not the only necessary ingredient. 

From those tasks found to be a reasonable part of the occupation (that is, job relevant to varying 
degrees), it then becomes meaningful to determine which of these curriculum candidates are worthy 
uf some expenditure of instructional resources and student time. Additional kinds of task informa* 
tiun art needed to focus attention on the critical training needs, though some of the relevance data 
may alsu be useful for this purpose. Selecting which job-relevant tasks should of training concern 
IS d more uncertain process than determining their performance characteristics and relevance. 
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Some relevant tasks may cKcur quite often, but be of tnvial interest for pre^mployment train- 
ing programs. This can occur for several reasons: (a) most students could be expected to be able 
to do the task before entering training, (b) training could be accomplished equally well or better on 
the job, (c) extensive job experience may be needed to learn a task, (d) task performance may differ 
quite radically among employment situations such that no standard learning approach is possible, or 
(e) only the more experienced workers are expected to perform a particular task, such that early learn- 
ing of it would not likely be retained until needed. Conversely, the learning need may be immediate 
and obvious. 

And, other relevant tasks may or may not be appropriate for training because of a wide range of 
other reasons. While full resolution of this issue is not likely, there are some kinds of task information 
that reasonably can be expected to provide important cues about areas needing training attention. 
Certainly useful would be knowledge of which tasks are related to on-the-job performance problems 
and difficulties. To benefit from the experiences and judgment of thooe persons who are close to the 
job and aware of the realities of the work situation, it would also appear useful to ask such persons 
where they feel each task should be learned. 
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Answers to these sorts of questions have been obtained for the three occupations serving as re- 
search vehicles in our R&D project and we are currently attempting to determine which data are most 
helpful in selecting the job tasks that most warrant training consideration. 

Well, in a brief and somewhat sketchy way, that's what we've been up to and about where we arc 
at the moment. In summary let me note several points that I thin^^are important. 

1. Our work in this project has been based on the assumption that the most approjJriate source 
of mformatiok?. for the identification of content for performance-based occupational prep- 
aration is the joD itself and those closest to and most knowledgeable about the performance . 
requirements of the job. 

2. There is a growing interest in job analysis and along with this interest a proliferation of task 
mventories. Task inventories are usually a means to an end, seldom are they ends in them- 
selves. 

3. Occupational performance surveys using task inventories can serve a number of useful pur- 
poses. When the purpose is to obtain data for making training deci^ons and curriculum 
plans, there is a real need to distinguish between that job content which is relevant to Work- 
ers m the occupations and that relevant job content which is most important for training 
consideration. Perhaps, in the end, th'^ will be the most important training use of occupa- 
tional performance surveys. 

1. The specific items of information about task performance needed for making training de- 
cisions and cuniculum plans is not at all clear at the present time, '^here is a persistent need 
for further research and development to determine what task information or sub-set of per- 
fi^rmance data is most useful for selecting content for training. 

V 

5. Finally, it should be noted that the process we are attempting to develop to select job con- 
tent for training can lead to the identification of that relevant job content which most war- 
rants training consideration. That is, it is a process for nanowing the focus to just those 
performance aspects of an occupation that most warrant some expenditure of instructional 
time and resources. The final decisions regarding the specific content of training programs 
and th*j kind of programs needed will necessarily be made at the local school or local plant 
setting and will take into account such critical^considerations as the availability of instruc- 
tional personnel, the needs, interests and prior experiences of students; and the physical 
facilities and available equipment. 
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ANNOTATED LIST OF SELECTED 
PROjGRAM PUBLICATIONS 

(October 1975) 

• / 

Automotive Mechanics OccupaUchol Performance Smvey. Interim R:port, (R&D Series No. 86) 
by S. D. Borcher and P. R. U\\^t, March 1973. 

This document is intended fr^; use in curriculum de^elopm(:nt fo: vocationii education 
programs in automotiv^ mechanics. The results of a task inventory Sv^rvey of automotive 
mechanics revealed that on-the-job training and company k Oonsorad training were the most 
frequent sources of joi) skills development. Sample siirve} materi«ds are kopended. 

Business Data Processing Occupational Performance Survey. Interim Report, (Ri\D Series No. 
88) by S. D. Borcher andil. W. Joyner, March, 1973. 

This reporv presents the results of a task inventory survey fpr data processing occupations. 
This interim report provides pertinent occupational data for curriculum developers, in* 
structors, And others involved in planning and conducting vocati^^ «nd technical pro* 
grams. Task performance frequencies, task commonali ties, and tir..e allotments were de- 
termined^ job descriptions for data processing were validau-v', :tnd «n occupational career 
ladder was found to be clearly indicated from the lowest to the highest job titles. Statis* 
tical results are appended. 

Secretarial Scieifz^ Occupational Performance St^-rvey. Interim Report, (R&D Series No. 87) 
by S. D. Borcl.9r and J. W. Jcyner, March, 1973. 

This report contiiins a revised task inventory that should he useful t^' practitioners intir 
ested in developing curriculum for vocatk.uci CuUc^Mon in the secretarial science ;ireas. 
The report validates job descriptions and determint^. what tasks are common to M sur- 
.^veyed jobs. 

Procedures for Con'^tructing and Using Task Inventories, (R&D Series No. 91) by W. !!, Mek**ing 
and S. D. Borcher, Ma.ish, 1973. 

TUis manual is dosignsd to help vocational <Mriculum expert? i^am proc^urcs for con- 
ittucang task invv^ntcri(i< and for analyzing ocv.upational performance. Informacon ob* 
\k<red by task invt.: tj;.y quett^onntir^z ran be used to design and revise vocational and 
:4/eer preparation curricuKi. *rhe reader it .^^ided through an explicit ael of steps and 
proceduires for •cr;jklitg injf effectively usi ig occupational information, ano is provided 
Ihe means by which he can periodically ^sses his understanding ol important concepts and 
terms introduced in the manual of procedures. 

A Methodology to Assess tht Content ^nd Structure of Affective and Descriptive Meanings 
Associated with the V/urk Environment, (R&D Series No. 90) by C. C. Liu and D. W. Essex, 
December, 1974. 

This report describes the activities ind results of several exploratory studies of the ust* "^f 
word association procedures to assess the affective and descriptive meanings workers as- 
sociate with the non-technical ast^cts of their woric environments. 
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6. Rating the Job Significance of Technical Concepts, An Application to Three Occupationi, 
(R&D Series No. 105) by H. L. Ammermin, D. W. Essex, ind F. C. Pritzner, December, lP/t4. 

This report describes a methodology for defining and inventorying the techn.(cal concopts 
that are relevant to an occupation. Technical concepts are the special knowledges ind 
understandings that have practical use to workers in the effective performance of their 
jobs. The method is described along with descriptive data summarized for three separate 
occupations: General Secretaries, Automotive Mechanics, and Business Data Ptogrammert. 

7, RCMAT. A Computer Program to Calculate a Measure of Associative Verbal Relatedness, (Oc- 
casional Paper No. 6) by M. A. Mead, June, 1975. ^ 



This document was f tepa.-ed for general use and as a companion report to the Essex and 
Liu document described above. It describes the characteristics arid usage of a computer pro- 
gram designed by CVE lo .iummarize associative responses ^ven to verbal stimuli by indi- 
vidual uid group respondents. The report was prepared to make the computer program 
transportable and available to other researchers and developers. 

8. Occupational Survey Report on General Secretaries: Task Data from Workers and Supervisors 
Indicating Job Relevance and Training Criticalnesz, (R&D) Series No. ) by H. L. Ammerman, 
F. C, Pratznor, and A. L. Burgin, 1975 (in progress). 

This report presents descriptive task data summarized for a national survey of (General 
Secretaries and their supervisors. Worker performance data, judgements about the critical- 
ness of performance and training, and supervisor expectations were obtained and are sum- 
marized for a set of 12 experimental questions for each task of the job. 

9. Occupational Survey Report on AatomotiKe Mechanics, Task Data from Workers ana Suner- 
uisors Indicating Job Relevance end Training Criticalness, (R&D Series No. ) by H. L Ammer- 
man and F. C. Pratzner, 1975 (ja progress). 

This survey report presents the same kind of descriptive task survey data for the job of 
Automotive Mechanic as noted above for General Secretary. 

10. Occupational Survey Report on Business Data Programmer, Task Data from Workers and Super 
visors Indicating Job Relevance c nd Training Criticalness, (R&D Series No. ) by H. L. Ammer- 
man and F. C, Pratzner, 1975 {\\\ progress). 

This report parallels the t\vo survey reports noted above (8 and 9) in presenting descriptive 
task survey data for the jub of Business Data Programmer. In combination, 700 employees 
(workers and supervisors) responded to the three surveys. 
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TASK SYSTEM ANALYSIS 



Wilma Bennett 
Hartford Iniuraiice Group 



About a year ind a half ago the Adfancement Center, edv^cation and training department of the 
Hartford Insurance Group, started looking into the benefi.s of performing more rigorous task analyses 
Dr. Sidney Fine gave us a tremendous aAist by presenting a workshop on Functional Job Analysis. 
With the background he prorided on the various elemenU that must be looked at in describing a task, 
we began developing a method of analysb tc meet our own needs. 

* 

Looking back, it's relatively easy to say exactly what our needs --ers. But ihey weren't always 
as clear to us as the following list makes them sound. We needed tasK analyses that would serve two 
basic purposes and we needed a form for recording these analyses that had certain characteristics. 

First, our purpoaes for performing task analyses: 

1. We wanted to use them, as many companies do, as guides for developing trainini materiah 
and programs. 

?. We also wanted to u»: analyses as guides for preparing tests of task perfoimance that pre- 
sented circumstances and called for activities as similar as possible to the actual job. 

In addition to serving these purposes, we wanted a way of recording tasks that had the (oilowing 
characteristics: 

0 One form would serve both purposes. 

0 The form would look uncompVu^attnl and be easy to learn. 

0 It Yould let us ci^pture task eIot:.ents unique to our industry. 

0 It would be easy file and retneve so that we could build up a file oi tasks for future 
reference. 



A Systems AM)roach 

llie (actor that let us meet both purpoaes whU ;:dtting the characteristics we wanted was not the 
wa> in which ue conceptualized the form. Instead ihh key factor wu the way in which we concep- 
tualized tasks. Joha Gibson, Dif^tor oi the Advancement Center, feels that a tack should be treated 
:a a systenvt^^^ smallest s^-stem that it is worth uur while to look at. Thus, the basic assumption upon 
which all of dur task analyiii work is built is thr^t a task is a system. . 

As everyone knows, much woric has been done in describing systems. We didn't have to re invent 
the wheel hert, systenu theory is already well dePned. Therefore, when we describe a task we do so as 
we wo\ild describe any syste m, in terms in inputs, actions and outputs. 
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Looking an example of a Yer> common task divicnd into inputs, actions and outputs will 
help m^kc clear the value the Advancement Center finds in thinking of a task as a system. It will 
also help illustrate why we use the term "actions*' rather thah the term "throughputs** in our de- 
scription. . . • ^ 



'' input: 

The task Answer ^ letter** (Exhibit I) is a good example to ase because it is bnef and will not 
get us sidetracked by insurance terminology. An input is defined jis ''An object or indivkiual which U 
acted upon in the process of task completion, without which t)ie uuk cannot be completed/* Pen, 
papei, stamps and envelope are mputs because the task can*t be completed without them. 

If there Is a trigger for tfl^task, soineihing which «iiui:ates to the employee that a task must be 
surted, then the trigger is also luted as an i;;put. The Usk "Answer a Ir Uer** is triggered to begin by 
receiving a letter. ''A letter received from another penon* is therefore Jisted as an input. 





* 


Inputs: 

• Papei 

• Pen 

• Stamp(s) 

• Envelope(s} 

^ A letter received from another person (the "trigger") 


• 








A orrectly addressed and stamped letter posted in a mailbox. 




Actions: 




. Write the letter.* 

• Address the envelope. 

9 Stamp the envelope. 

« Ini^rt letter isi vhe envelope. 

« Seal the envelope. 

« Deposit sealed envelope in a mailtiox. 




*Throughputs ar&^underlined. 
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Outputs 



After describing the inputs of a task, I prefer to look next^at outputs. Knowing the expected 
dutput gives me paf ahieters to stay within when I lisjt the actual actions of a task. 
\ . ^ ' • - 

In our exam^e the desired output is "A correctly addressed and stamped envelope that has been 
post4:(} in a mailbox.'' Whoever undertakes this task cannot assume the task has befif completed just 
because the letter has been wriiisn. If the letter hasn't been mailed, this task is unfinished. So, just as 
inputs often include a trigger telling when a task should begin, outouU^ include whatever information 
is available about when the task should end. 

*- 

W^henev^ a quality of performance standard can be assigned io a task, that standard is stated \H 
the iv^utputs. ICsomethiug must be free from «rr|)rs, then the phrase "free from errors" must appear 
in the output. 

Actions ' , 

Actions, obviously, are the various steps a pc^on goei through in perfomiing a task. Action st^kte 
ments always start with a verb, as opposed to input and output statements, which always be^n with a 
noun, adjective or article. If you look closely at the 'action statements in Exhibit I, the first one for 
example, you can see that sometimes an object is produced that looks v^ry much lUce an output. 
These objects arc called (hroughputs. They are not outputs because |.roducing them does not mean 
the whole task is completed.. ' . ^ 

We choose the titk Actions" rather than ''Throughputs'* because if we list all of the actions of 
u task ihen we capture all of the throughputs. But the opposite is not true. Listing all the through- 
puts will not4G^h all of the actions t)f a task. 

The Value of Task System Analysis • \ 



Earliet it was stated that using inpuw, outputs and actions has a specific valye for the Advance- 
ment Center. The value comes from the fact that insurance is a paper-pushing industry. Frankly, our 
employees don't alwa>s know when they are producing outputs and when they are producing through^ 
puts. In a paper industry it*s often' hard to tell them apart. / , 

A baker whose cake tasted awful would never think heliad done a job well because he had meas- 
ured and stirred carefully. The difference between throughputs and outputs is very clear in a bakery*. 
But it's not always clear in insurance. Wheix completing form X-375 is done somewhere enroute to 
completing form Q-982, a person doesn't automatically see that one is a throughput and the oihex an 
output. This is especially true whenjorm X-375 takes two hours to fill out and Q-982 takes two 
minutes. 

The Task Statement Form 



The form that has been developed to record task information is called a task statement (se« 
Exhibit II). W*e use the same form for both of the pyrposes mentioned earlier, developmg tenis and 
developing instruction. When the task statemenLform is used for dev<eloping a test, only tho» blocks 
that have just been described are completed, inputs, outputs and actions. (Of course, basi^ idt^.itifi* 
cation informaiion is always recorded.) Knowing what an employee^tarts with, what lie must end up 
with, and the actions he performs along the way gives us enough information to develop an accurate 
test of performance. (Note on Exhibit II that the actions are much more abbreviated for designing a 
test than they would be for designing instruction.) 



IV/ 



TASK STATEMENT 


POSITION TITLE: Rating techniciin 




TASK. Classify, rite, and code Commercial Automobile policies usinf the new ISO system. 


GOAL 


OBJECTIVE 


■> — r- 

LNPUTS 


OUTPUTS 


A partially completed Supplemental 
Rating Application A-3622 (the "triaer") 
^ An.ISO Autombbile Insurance Manual 
• A Rating Guide ' 
9 A calculator 


, An accurately and completely 
filled out Supplemental Ratinf 

Application. 


ACTIONS 




^ Refer to the ISO Manual and Rating Guide to locate needed information, , 
^ Do necessary compuutitns ' t 
• Fil! in these blocks on form A-3622: J 


' r-R^ting Clas&fication 
—Business Use 
-Factor for ^ze Bus. Rad, 
-Factor (under Spec. Ind. Tlais) 
^ -HCAMRP factor 

-Final Rating Factor 

- Bi Ukh. Prem. 

—Medical Payments Premium 


-PD LUb, ?tem, 
—Uninsured Motorkt Premium 
. -Rat£rs (after non-Coil Coy*) 
-Rates (afier CoU, Cov.) 
-Premium (each covered automobile) 
—Towing and Labor Costs 
—Premium 

—Totals (at bottom of premium column) 


COMPETENCIES 

m 

* 




ATTRIBUTES " . ^ 



EXHIBITII 



Example of a Task Staiemnnt for ((esigning a test. Notice that'although the actions are abbreviated, 
the throughputs aren *t* 

1(8 



Competencies 



However, when the task stati>ment is intended to lid in the design of instruction, then a great 
deal more information must be collected. We need to know» for example, what knowledges and skills 
the employee must have in order to perform the actions listed (see Exhibit III). The knowledges a per- 
son must have in order to perform a task are not always clear from the actions he goes through to 
perform t^at task. For example, the actions in Exhibit III do not tell us that a Classification Code is 
put together from the Primary Rating Factor, the Special Industry Class Code, and the Major Industry 
Classification G'uup. However, the employee needs to know this to complete the code. Therefore, 
"Parts of a Classification Code" is listed as a required knowledge. 

Competencies vs. Attributes 

You may have noticed in Exhibit III that knowledges required to perform the task are listed in 2 
places, under Competencies and under Attributes. One basic difference between the two is that Com- 
petencies ar j knowledges and skills that can be taught whereas Attributes cannot be taught. An ex- 
ample of an attribute that cannot be taught is a height requirement of 6*8" in order to be a profes- 
sional basketball player. ' 

Another difference betwtet. Competencies and Attributes lies in the fact that Competencies are 
task sp**.lfic ana Attributes are r ot. A Competency can be referenced to more than one task, but it 
exists on«> in relation to tasks. An Attribute, on the other hand, can exist without reference to a task. 

Attributes 

In addition to listing things we can't teach, we find it useful ^o include in the Attribute block 
things we don't intend to teach. Rating a Supplemental Application is a complicated task to learn. 
We're not goiiig to try to teach the person how to multiply decimals at the same time. B«ting able 
to multiply is a prerequisite for learning to rate and is listed under Attributes. 

Attributes thus include all of the knowledges and skills we don*t intend to toach and all of the 
required knowledges and skills we can*t teach. The attribute block is where we include information 
about inter:^ersonal skills, decision making skills, language skills, and math skills. We are attempting 
to develop a serie.s of tests, directed at our own company's needs, to measure these basic attributes. 
Hiatests are leveled and the levels will be correlated with*job positions. 

An Evolving Task Statement Form 

As indicated by he fact that we've been working witTi task analyses for a relatively short time, 
part of wiiat we are doingJs still on a "shake-down cruisr.*' Very possibly, adaptations will continue 
to be made. The n^ost likely place that will see changes will be the task statement form itself. For 
example, we may find it necessary to indicate somewhere on the form whether the task is being de- 
scribed for purposes of testing, for purposes of training, or for both. In addition, we have found 
Robert Horn's Informaion Mapping so useful for training materials, that we may^try to use it for 
our task statement^ Finally, we sometimes find we don*t have room on one page to say everything 
that we've got to5ay. We could change to a longer page, to two pages, or to both side^ of the page. 
AVhichever we <*ndjjp with will be what works best for us. 

This point is made to emphasize the fact that we've dtvvlopcd something to fit our needs. We 
don't anticipate; 'hat our solution, will fit anyone else's needs exactly. However, if part of our solution 
is useful to others, we will be more than delighted to share. It will, in a small way, repay the many 
people who have shared with us at The Hartford and enetLlcd us to develop task analyses that work 
for us. • ' 
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TASK STATEMENT 
POSITION TITLE: Rating Technician 



TASK. ' Classify, rate, and code Commercial Automobile policies using the new ISO system. 



GO:xL 


OBJECTIVE 


INPUTS 

^ A partially completed Supplemental 

Rating Application A-3622 (the "trigger''/ 
« An ISO Automobile Insurance Manual 
« A Rating Guide 
9 A calculator 


OUTPUTS 

t An accurately and completely 
filled out Supplemental Rating 
Application 



ACTIONS 



A. Use the Rating Guide to determine the Primary Rating Factor and Class Code: 

1. Locate this table: Detepnination of Primary Classificatio n Factor and Code. 

2. In the column marked SIZE, locate the area for L (Trucks). 

3. In the column marked BUS, locate the S category. 

4. In the column marked RADIUS, locate the L category. 

5. Follow a straight line through the above 3 items to find the correct factor and code. 

B. Use the Rating Guide to determine the Secondary Rating Factor and Code. 

1. On form A-3622 locate the letter designation for Special Industry Class. 

2. Locate this table on the Rating Guide: Secondary R atinir Factor and Code. 

3. Etc. 



COMPETEiMCIES 

Knowledge of: 

Primary Rati .g Factor Classification 
Exposure Types 
Vehicle Size Classes 
Business Use Classes 
Radius Classes 
Special Industry Classes 
Major difference between form A-3622 
and form A-3471 
The parts of a Classification Code 
Total specific vehicle rate -formula 
Etc. 



Ability to: 

« Locate Primary Rating Factor and 

Class Code 
9 Determine Secondary Rating Factor 

Category 

Calculate Final Rating Factor 
Determine Liability Base Rate 
Calculate BI Vehicle Rate 
Determine Vehicle Age.Group 
Calculate PD Vehicle Rate 
Round off according to Rule 10 
Etc. 



ATTRIBUTES 

« Ability to add, subtract and multiply decimals 



EXHIBIT III 



Example of a task statement for designing instruction. 
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JOB TASK ANALYSES IN TEXT AND TEST DEVELOPMENT 
A Method for the Novice Training instructor 



Raymond D. Bland 
U.S. Coast Guard Institute 

ABSTRACT 

The job task analyses for enlisted ratings in the U.S. Coast Guard provides the basis 
for designing and writing advancement examinations and non-resident training courses 
produce! by the Coast Guard Institute. A highly structured, closely supervised procedure 
allows subject matter specialists who have no experience as instructolrs or test writers to 
produce job-relevant materials from the job task analysis. This is done with little or no 
time lost to formal instruction or mis-directed effort. The process produces a spinoff of 
instructor insights which allows follow-on training to focus on a higher level of sophistica- 
tion than the same amount of job-entry training for the instructor would allow. 

The Supreme Court of the United States has mandated in the case of Griggs vs. Duke Power Com- 
pany that **test5 must measure the person for the job and not the person in the abstract." This deci- 
sion places a requirement on thoae who design and administer selection tests to design tests which do, 
in fact, measure each person for ^he job he is seeking. One method, a very effective one, for meeting 
job relevancy criteria is to develop the tests from^job task analyses. 

The job task analysis describes the many facets of the job and establishes the relative roles of 
these various facets in job performance. Computer analyses of percent of persons performing the 
specific tasks, or percent of time spent by all members performing the tasks, or consequences of in- 
ability to perform when required, all provide the test designer with a wealth of data. Tliis data can be 
used to construct tests which are directly related to tasks performed on the job. This method of test 
conslruction results in a high expectation that the tests will thoroughly meet the criteria set by the 
Congress of the United States in the Civil Rights Act of 1964 and interpreted by the Supreme Court 
in Griggs vs. Duke Power Company. There is a further expectation that the test will also be a more 
effective selection instrument than tests which may be developed by other methods. 

It is easy to describe a test development system which is baaed on job task analyses. It is quite 
another thing to actually prepare such tests. Actual preparation requires a close coordination between 
subject matter specialists and educational technologists to ensure success. Without this coordination 
the tests will be neither relevant to the job nor predictive of future performance. The subject matter 
specialist must have an input to ensure the technical accuracy of the test items and the educational 
technologist must have an input to ensure that the test items provide a relevant sample of factors re- 
quired for the job. The input of each must complement the input of the other. 

The U.S. Coast Guard Institute produces its selection tests for the enlisted advancement system 
by using this team approcah based on job task analyses. Data from the job task analysis for each en- 
listed rating (specialty) in the Coast Guard is used as the basis for designing correspondence course 
training texts, criterion referenced tests to establish successful course completion, and norm refer- 
enced tests to rank order candidates for advancement within each rating. Though designed for differ- 
ent purposes, each of these three products.is developed from the common ground of the job task 
analysis. This common development assures efficient training and testing by focusing on job relevant 
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information and precluding that which is irrelevant. It also allows the subject matter specialist, who is 
not a professional educator, to design text and test materials with minimum supervision and review. 

The development process is highly structured so that product review and revision can be narrowly 
focused. Typical models for instructional systems show a single step from the job task analysis to *'Be- 
havioral Objectives/' followed by another single step to "Selection of Instructional Method." This 
single step oversimplication is what leads to many of the valid criticisms of the use of behavioral ob- 
jectives in curriculum development. Too often the behavioral objective statements focus on trivial and 
glib statements cf deared learning outcomes. The value of the job task analysis is greatly reduced 
when behavioral objectives are intuitively stated in advance of extensive, detailed manipulation of the 
job task analysis data. By increasing the number of steps in the process and formalizing the actions to 
be taken to accomplish each step, meaningful learning outcomes can be described. In the process, the 
subject matter specialist will produce working documents which he can later rely on for the detailed 
work of writing texts and tests. The rigid structuring of the early stages of the development process is 
difficult to sell to new subject matter specialists, but the payoff in the latter stages is so great that thty 
become avid proponents by the end of the process. 

Subject Matter Specialists at the Coast Guard Institute are senior technicians brought in from 
field duty for a single three-year tour of duty as instructors. They are all Chief Petty Officers, Senior 
Chief Petty Officers, or Master Chief Petty Officers. All have devoted the better part of the past 
twenty years progressing from job entry levei in their ratings through the journeyman level to the 
supervisory level. Their subject matter knowledge and their perspective on the actual job environment 
make them particularly valuable in developing job related texts and tests. They are complemented in 
the process by civilian staff advisors who are eifher professional writers or educators. 

The new instructor (subject matter specialist) is first exposed to a brief indoctrination program. 
He is shown each of the steps to be followed in the process and is given a brief explanation of each 
step. The object of this indoctrination is to acquaint him with the requirement to go through a pre- 
scribed process, not to make him proficient in the process itself . We want him to be aware from the 
outset that text and test development must follow definite steps. As he reaches each of the steps in 
the process, suff members will provide additional training to allow him to proceed to the next stage. 
This allows maximum efficiency in staff use. Both the subject matter specialist and'the staff advisor 
will focus their efforts on one narrow part of the process »t a time. Each will know that the work pro- 
duced to that point has been reviewed and approved, so there is no need to go over the same ground 
again. Because approval is required before proceeding to each new step there is assurance for both the 
wnter and the advisor that there is no need to regress to earlier steps to correct defects carried through 
several steps. Correction occurs from the beginning of the process. Extensive, formalized review elim- 
inates rejection of near completed work, and of course, avoids the frustration which goes along with 
rejected work. 

The starting point is the job task analysis. Our interest for this process is confined to three types 
uf analyses, percentage of people performing the task, percentage of time spent on the task, and grade 
level of people performing the task. The Enlisted Rating Qualifications Manual provides guidance on 
which tasks are required for each grade level, and the instructor s experience fills in the gaps that may 
have been left in preparation of the job task questionnaire. Using the data on numbers performing and 
time spent on each task, the instructor must first select out those tasks which^caanoLbe taught in a 
correspondence course. Tasks which require practice, manual dexterity, close supervirdon, or "feel" 
are dropped out. This review also eliminates those tasks which should not be taught in a correspond* 
ence course. The target here is the list of tasks for which on-the-job training and drills have been pre- 
scribed b> the Commandant or the District Commanders. This divides the job tasks into two cate- 
gories, "those to be taught" and "those not to be taught.** The rest of the steps apply to the develop- 
ment uf corr^jspondence course material based on the list of tasks "to be taught." Those in the "not 
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to be taught'* category will go through an identical development process, and will be reunited with 
the first category tasks later in the process. 

Two other decisions must be made during this stage. A cut-off point must be selected to separate 
those tasks performed often enough to be taught and those performed too seldom to be worth teach- 
in^. The second decision also requires identifying those tasks in the "too seldom performed*' category 
which, though seldom performed, are critical on the job. Hie amc unt of resultant text material is one 
of the main criteria for fixing the cut-off point. Hie services of a itaff advisor are available during this 
ph^^ to asist the instructor in deciding whether text can be dev loped on a task, and if so, how much 
tf/xt will result. When this step has been completed, the supervisor will review the list of t^uks to be 
(aught. 

STEP TWO 

Using the ''paygtade performing** form of the job task analysis and the Enlisted Qualifications 
Manual (Quals Manual), the instructor will assign each of the tasks to the proper paygrade, E-4 
through E-7. ThiS job task analysis will tell him which paygrade is performing the tadcs and the Quals 
Manual will tell hini which paygra.de must be able to perform it. If the task is required at a lower 
grade level than that commonly performing it, the task will be taught at the lower level. It may also 
be taught at a lower level than indicated by either the job task analsysis or Quals Manual if a more 
efficient progression of rating courses will result. Often we find that many of the things required at 
the E-6 level on the job can be better taught at the E-5 level. Because enlisted duty assignments in 
the Coast Guard are not rigidly controlled by paygrade, we are able to make this type decision without 
discomfort. Instructor experience and judgment are just as important at this stage as the job task anal- 
ysis and the Quals Manual. 

During this stage the instructor must often revise step one, adding or deleting material. Courses 
for four giade levels will be required. If a grade level becomes flooded with material to be taught, the 
text will be too cumbersome to be completed by the students Adjustments are'made by shifting some 
material to a lower level course or by deleting some of ihe tasks selected in step one. If too little ma- 
terial results for a grade level, additional tasks may be added to the original list. The supervisor will 
review this stage when it has been completed. 

STEP THREE 

The supervisor will specify which of the four grade level courses is to be developed first. The in- 
Btiuctor then takes his list of tasks for that grade level and begins several steps of organizing and sub- 
di\iding. 

Tasks listed on the job task analysis are in the order dictated by the-responses of participants in 
the job task survey. To be useful in writing text material, the tasks must be regrouped. The ta^s are 
first grouped into broad categories, or topics, based on the similarity of tF.a tasks. Because this is pri- 
marily a clerical chore and is very much within the realm of expertise of the instructor, there is no re- 
view required before the next stage is begun. When the instructor is satisfied, he moves on to the next 
stage. 

STEP FOUR 

This stage is brief, and, again primarily clerical. All of the tasks within each topic are put into a 
logical order. The instructor has free choice in deciding on the order, arranging the tasks from simple 
to complex, in the order they are performed, or any other order which he feels is logical for the topic. 
He proceeds independently to the next stage. 
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STEP FIVE 



Once again the instructor is operating within the realm of his experience and expertise. Each of 
the usks is broken down into all ot the steps necessar>* to complete the task. This subdivision con- 
tmues until the list of steps, or Job Subtasks, cannot be broken down any further. The supervisor re- 
enters the process and reviews the third, fourth and fifth stages. 

STEP SIX 

For the first time the instructor is going to operate out of the realm of his expertise, though not 
necessarily out of the realm of his experience. In this sixth stage, he will convert his list of Job Sub- 
usts in to a list of Lesson Subtasks. So far he has been dealing only with what is required on the job, 
where there are boats, engines, tools, typewriters, radars, radios and other similar things. Now he must 
convert the list of job subUsks to lesson subtasks, b^ause in the.lesson the only things the student 
will have are papei;.anJ pencil. Each lesson subtask must be a paper-and-pencil version of a job sub- 
task. Generally, leaon subtasks will be sUtements of the decisions which are required to perform the 
job subtask. 

On the job the student may be ttquired to sharpen tooJsjm the lesson he should be required to 
select the proper grinding tool, select the proper ^ngle of the tool edge, or identify a properly sharp- 
ened tool in a display of two or more tools. On tht job he rr.ay be required to repair a diesel engine; 
h> the lesson he should be required to identify repair procedures, or tools, or symptoms of proper and 
improper operation. Every job task requires decision making. These decisions provide the material to 
draw on for lesson subtasks. 

This step IS based on the assumption that if the student is able to perform the lesson subtasks suc- 
cessfully, he will probably be able to perform thej^qb subUsks successfully. Performing these lesson 
:,ubtasks constitutes the primary difference between studying a correspondence course and reading a 
reference book. Just as the classroom teacher requires certain activities from his students, so the cor- 
respondence course instructor lequires activities from his student. The staff advisor works closely 
with the instructor on this stage. Because each staff advisor works with about ten instructors, he is 
able to carry over many ideas from course to course. The supervisor reviews the work at the end of 
this stage. 

STEP SEVEN 

The instructor designs the end-of-cour.se (criterion) test at this point. Successful completion of 
the course, a prerequisite to advancement, is achieved by obtaining a pa'^ing score on the end-of- 
course test. Because it is a prerequisite to advancement, the ttist must be highly job relevant. To be 
useful, it should also be a reifionably good predictor of the likelihood of on-the-job success. 

It IS fairly easy at this stage to design such a test by selecting lesson subtasks to be canied into 
the end-of-course test. The test will contain 100 multiple choice items based on 100 or fewer of the 
lesson subtasks selected for the test outline. Because the work of ensuring that lesson subtasks arc 
paper and pencil exercises has already been completed and reviewed, writing the actual test items is 
easy. As each segment of text is written later on, the instructor can design student activities and end- 
of-course test items for that segment of the text. By designing the student activities and end-of-course 
test Items at the time the text is developed, we can have a greater expectation that the test item will 
be a useful sample of the student's undeitst^nding of the text. This stage is reviewed by the supervisor 
and by the staff Testing Psychologist to ensu«:e that the outline represents a realistic sampling of 
course knowledge. 
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•STEP EIGHT 



The instructor must now write an outline for the text manuscript. He studies his Ibt of job a«id 
k^on i>ubtasks and writes a chapter by chapter outline for each of the books to be included in the 
course. He will organize his outline so that he can write a unit consisting of text and student activities 
which the student will complete and score himself. Each unit is designed to be completed in one hour 
or less. When the supervisor approves the course outline, the instructor begins writing his text, student 
activities, and end-of-course test items. 



Advancement Examinations 

The list of tasks ''not to be taught** is subjected to the same procedure through step six. Vzi 
of lesson subiasks from the 'to be taught category is combined with the list of test subtasks from the 
*'not to be taught** category to form a bank of subtasks for use in writing the advancement examina- 
tion. Subtasks from both categories are used to produce examinations which cover all aspects of the 
job so that we may rank order candidates who have al! been certified by their commanding officers to 
be fully qualified for advancement. 

The test outline for the advancement examination is developed strictly from the Enlisted Rating 
Qualification Manual. Instructors nay vary the weighting of various portions of the qualification, but 
the) may not deviate from the specific job requirements laid out in the Nfanual. The lesson/test sub- 
tasks derived from the job task analysis, most comprising the steni and response for a multiple choice 
lest item, are then fitted into the outline to produce the examination. For both the advancement ex- 
^inations and the endof-course tests there is little left to do beyond writing three distractors to go 
with the stem and response developed from the test/lesson subtask. 



EPILOGUE 

During the seventh and eighth steps we have been surprised to find some unforseen results.^ 
We had expected that the instructors would develop very good text outlines and that they would be 
able lo easily produce very lean text manuscripts. We also expected that the quality of our student , 
activities (lesson quizzes) and end-of-coucse tests would greatly increase. We did not expect, however, 
to find our new technician turned-teacher lo be replacing "job task** with "psychomotor activities.** 
"Job subtask** became "enabling behavior outcome,** and "job task** became "teiminal behavior out- 
com.** 

M);ch to our deli^'ht, this process had provided our new instructors with the b'^.'^is for a clear 
underst anding of the meaning and use of behavioral objectives, and an awareness of the relationships 
between the psychomotoi and cognitive domains of learning and performance. A.* the instructor pro- 
ceeded from step to step in the development process, he was working with concrete tasks from the job 
he had previously been performing. Because the tasks were concrete and directly related to both his 
experience and the project Ii^ w^s working on, the "light** quickly clicked on. The instructor, by 
taking a retrospective viev;' of what he had just done came to a rapid undeii?tanding \ 'ith very little 
effort on anybody^s part* 

r 

The final product, of course, turned out a^^ expected. The text was lean, the tests were job rele- 
*anl, a.nd no time had been wasted. Students and candidates for advancement will be confronted with 
texts and te^ts which have been respoadbly prepared under rigid conditions of accountability. 
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TASK >»jN'ALYSIS: 
THE PASIS FOR PERFORMANCE TEST AND INSTRUCTIONAL DESIGN 



Robeit N. Johnson and James N. Richminn 
U. S. Army Institute of Administration 



Recently both the civilian and niilitary educational communities have herom; enamoitrJ with the 
concept of educational accountability in vocational ei5ucation and job training. Simply stated, educa- 
tional accountability requires specification of Ihe desired r»ulU: of the system, meuurement cf the 
instruction in terms of these results, and a continued search for ways to lower costs or imporve the 
program. The foundation for attaining accountability is taik analysis, the procen of specific .ion o' 
training outcomes in terms of job ictions, job conditions, a id results of job performr^ct-. Under this 
philosophy, task analysis b the basis for development of th',- performance te.^ which r/ill be used to 
measure instruction and for the design of the instruction I'jelf. Tht cost and quality of th» instruc- 
tion, therefore, is tied directly to the quality of that task analysis. But what is the qoality cf our cur- 
rent task analyses? Do they accomplish the purposes for which they are intc-nded? Dr. Ch.Mes Jack- 
son of the U.S. Army Armor School in the report of an Instructional TKhnoir^xr Study Group 
observed that "personnel performing task analysis activities were preparing lask listi of imr'iecise tasks 
and were not analyzing these tasks in sufficient detail to facilitate instructional itfi^.' I^is paper 
addresses a methodology for the use of a well documented task analysis in performance 'jctt and in- 
structional design. 

In addressing the problems inherent in tksk analysis it is important to identify a conceptual model 
for the efficient use of task analysis information h\ the instructional design procesi, S'.<ch .nio>j*ls are 
common and almost all agree as to what task analysis should accomplish. A typictl model, .umplified 
to chart the relationship of task analysis to other instructional design is shown on ^his transparency 
(see Figure 1). 



mSTRUCTIONAL DESIGN PRODUCTS 



LIST OF 
JOB TASKS 



INCUMBEI^TAND 
SUPERVISOR JOB DA'^A 



TASK 
SELECTIONS 



TRAINING SITE 
SELECTION - 




DETAILS OF 
SELECTED TASKS 
+ 

PERFORMANCE 
TESTS 




INSTRUCTIONAL 
PACKAGES 



e 



TRAINED . 
STUDENTS 



Figure 1 
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The first re..uirement is to maJce a lisi -^f tasks performed by j.f J"l""^.t,«"|^ ■ 




lessons. 

Exainin^non of these products indicates that two leveU of ttslv jpecificity ire required in iiutnic- 
tionil deaijn (see Figure 2). 



LEVELS OF TASK DEFAIL 



DETAIL 
Short Task Statement 

Detailed Task Description 



jSED FOR 

Task Inventory 
Data CoUtction 
Task Selection 

Training Site Selection 
Test Design 

Instructional Package Dewgn 



Figure 2 



First, short terse statemenU of job taslcs ,ire used to make the tisk '"^f "t^,'^- .JJ^^^^^^^ 
data nec^ry for task selection. Task statements which are L)ng or detailed do not facilitate data . 
Jo lect o^nd Lsult in.a cumbersome task list. Second det*d descriptions of ^f J^T^ 
se'-t the training sites, design the performaiice tests, and develop the instructional P^P^^-^-Jj^l^^ 
f^^ iKk statements uUd to collect job data c'-o not contain sufficient detad for th«e later function*. 
ThTv may cell you whit is done, but do not teU you how. To select a training site, design a perform- 
a-te tTst or develop an instruction^ package, the designer n.>e(is to knov; th. cue. to Performanw 
Jhrelements of performance, the conditions which affeo.t perlcrmancc. and the results of acceptable 
taSi'. performance. 

Inst 'uctional designers haie recognized these t'vo different levels of derail, but havo not recog- 
nized cl\e relationship between the two. 

With -apect to the ^eed for short terse '.aslt statements, the niajor problems has been Isyds of 
specificitv. 'x«sk inventories have bec-n prepared which contain statements wh..h 
to Dcrmj^urthei detaUedanalysis or-arc too narrow to be considered independent tasks As ^ rMuL, 
^atfJ^Sed and sele Hions are made only find out that the original task statemenU are wade- 
quate to serve as the b?i:is fur ict-jte steps i*-. mstructional design. 

For examples of this [Problem of level specificity, consider these examples (see Figure 3) extracted 
from the task inventory for the military job of unit Fi:st Sergeant. 
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EXTRACT OF TASK UST 



JOB - COMPANY FIRST SERGEANT 



< 



SUPERVISE UNIT ADMINISTRATION 
SAFEGUARD CLASSIFIED MATERIALS 



TOO BROAD 



SELECT A DETAIL USING A DUTY ROSTER 
INVENTORY" CLASSinED DOCUMENTS 



ACCEPTABLE 



DETERMINE CAUSE OF SOLDIERS ABSENCE 
LABEL CLASSIFIED MATERIAL 



TOO NARROW 



Figure 3 



Some task stitements au so broad as to preclude detailed analym since the exact parameters of 
the Usk are not defined. Others are so narrow that analysis reveals they are really elements cf a larfer 
usk. Considr.f the first two task statements on the list Then tasks have a different meaning and in- 
terpretation for each of us. Each powble interpretation would remit in a different detailed analysts 
of the task .^nd thus change both the training and test content. If we do not catch this type of task 
pkior to ;he collection of job data, then problenru will arise in the selection of tasks for training. Vary- 
ing levels of specificity distort values of "percent performing** and other statistics calculated from 
cumulitive fob di:ta. Even the taw data for this task will be suspect since no one can be certain which i 
portion of the resix>nses pertain to the various interpretations of th^ task. In effect, we are not in any 
better position to design training than we were when we used subjercts rather than tasks as the basis for . 
instruction^ design. 

Now, conisder die last two task statements on the list. A cursory examinntion of these tasks 
shows no real proViems, but a detailed analysis reveals that these tasks are really piot of a larger, more 
complete and cch^sive, task. It makes little sense to collect job data on these ehments of performance 
wh^n detailed un.dysis of the larger task may establish that total task cahnot be adequately performed 
without th elemvint. In addition, including task elements like these in the inventory* increases the 
administrative burden of data collection. 

Our objective is to wn^ statements at the level of specificity which repreaents a meaningful 
"whole** on the job from the viecpclnt of the job incumbent. The only solution to this problem of 
task specificity is a careful edit of the tmk inventory prior to data collection, ccml'Xied with proper 
use of iterative feedback from the further detailed task analysts. Management must i^sihzt that no 
design product, including a task inventory, is initially perfect. The ''trial-test->^lsie'* t^tocedures of 
validation of instructio^-^s! ntsterials are applicable during the process of task analysis as well. If, dur- 
ing the detailed analysis of a task statement we find the original fevel of specifici'.y was too broad or 
too narrow, then the task inventory must be changed. 

In editing the list prior to the collection of job data, the analyst must carefully conuder eacK 
statement and deteimine not only whether it is a task, but also whether or not it i: written at a level 
of specificity which facilitates further detailed analysis. Although, we utilize the commonl> accepted 
definitions of a tadc, we have added a new dimensic . In addition to the requirtfn;^nts that a task is a 
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highly specific unit of job activity stated in job terms with an action verb and an object, must have a 
definite begmning and a definite end, must have hi least one cue or stimulus which, in the real world 
signals the incumbent to perform that task and must be observable and measurable, we insist that a 
task must be the smallest unit of joli activity performed for iU own sake in the eyes of a job incum- 
bent in the job situation (see Fi^re 4). 



A TASK MUST BE THE SMALLEST UNIT OF JOB ACTIVITY DONE FOR ITS OWN 
SAKE IN THE EYES OF THE JOB INCUMBENT IN THE JOB SITUATION 

Figure 4 



It IS the smallest unit of meaningful perfomianca to the worker. This is the key distinguiihinf * 
characteristic between i: task and an element of a task. For example, a mechanic does not removt tJk 
wheel and lire from a vehicle for the purpoae of removing the wheel and tire. The removal is made in 
order to accomplish one of several tasks, e.g., "rotate the tires," repair a flat," "instaU new tirta,** etc. 
Tliese latter statemenU are tasks because they are done for their own soke in a job situation. Each of 
them requires, as element of performance, the removal of the wheel ainl tire from the vthklt. By 
mcluding "done (or its own sake in c lob situation" as the major charKteristic of a task as oppoitd to 
an element, we permit differentiation among tasks and elements. By including "done for its own sake 
4n « job situation" as the major characteristic of a task as opposed to an element, we permit differen- 
liauon among tasks and elements. By including "in \ht eyes of the job incumbent" we recognize that 
a statement which is a usk at one job level may be a duty or only an element at another job level. By 
mcludmg 'the smallest unit of meaningful performance" we recofcnize that duties and jobs etc., are 
meanmgful units of performance, but do not furnish sufficient deUil to pemit further analysis. While 
judgement of this criteria for a listed task statement is subjective, the use of Robert Mager's "Hey- 
Dad" test* is a fairly good indicator of whether or not the statement is a task or an element In this 
test one imagines the supervisor asking the job incumbent "What are you doing now?" If the job in- 
cumbf iit could be expected to answer with the listed statement, then the statement is probably a task. 

The preceding discussion emphasized the first requirement for ^.pecif kity m task analysis-the 
need for short, terse Usk statements which rrprvMjiil ineanuigful "wholes" to job incumbents. Now, ^ 
we would like to shift the discussion to the second requirement-the need for detailed ta^ descrip- 
tions which provide the basis for design of tests and instructional packages. In relatk>nship to the 
ov-irall model of instructional design (see Figure 1) the production of these detailed task descriptions 
follows job data collection and task selection. The position of the deUiled analysis in the process is 
an important factor in establishing a logical and cost effective sequence to the overall instructional 
desigri •.ystem. It is Lgical to perform the detailed analysis at this point since the information derived 
IS not requued earlier in the process. It is cost effective since it precludes detailed analysis of tasks 
. which may be elimmated during the task selection procedure, The deUiled task analysis is still at this 
stage, divorced from training. This b as it should be since we are concerned with how the task is per- 
formed in the real world, not how it will be perfprmed during training. One of the gravest errors we^ 
could make during design would be to base our detailed analysis, and hence our t^sts, on the content 
of the trammg rather than on the actual job requirements. For this reason, we must separate the de- 
tailed task analysis from the Uaining analysis which results in design of lessons, instructional packages, 
or media materials. 



*Mager, Robert F., Goal Analysis, Belmont, CA. Fearon Publishers. 1972, page 30. 
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The central problem in developing a xleUiled task analysis is to find a way to document the work 
uf the analyst. While forms, procedures! and the like are not ends in themselves the most brilliant 
thought, if not carefully recorded for future reference, is Ibst and useless.. Good^ documentation 
should be flexible, easy to understand, easy to reference, and have no unnecessary components. Since 
documentation is only a tool it should be easy and^<;heap to constnjct and reproduce. Good docu- 
mentation should direct |he thinking of a mediocre analy'^tjto discover the critic^ aspects of the task, 
but not restrict the thinking of the food analyst to discover imaginative new solutions to old prob- 
lems.^ Because tasks are different, format should not dictate theanalysi* proceiutc. 1*0 a large extent, 
therefore, the usefulness of the detailed tjsk analysis, and hence the quality of the following instruc- 
tlonal dedgn products^is dependent on the type of documentation used. 

In the U.S. Army Institute of Administration we have had considerable success documenting the 
detailed task analysis with a format w^ call a Task Structure Analysts ^o differentiate it from activities 
concerned with the task statement only. On the Task StruAure Analysis form we document four ma> 
jor aspects of task performance (see Figure 5). O 



TASK STRUCTURE ANALYSIS 



DOCUMENTATION OF: 

1. CUES 

2. CONDITIONS 

3. ELEMENTS OF PERFORMANCE 

4. RESULTS 

Figure 5 



First, we record the cues which initiate the task. Second, we state the elements of performance 
in their logical sequence. The elements of performance are either the steps in th^ execution of the 
task, or the decisions made during performance which alter the sequence of the proceti. Next, in re- 
lation to each of the elements of performance we document the conditions which are amociated with 
performance. These conditions may be tdoU^ references, job akls, environmental or attitudinal factors 
which affect performance. Finally, we record the ck .acteristics of the results of adequate task per- 
formance. These results of task performance may be documented either in terms of characteristics 
of an acceptable product, key steps in an acceptable process, or in terms of known errors in execu- 
tion of the process. 

At this time I would like to pass out a completed Task Stnicture Analysis to give you an ex- 
ample of the format and procf^dures used to record the detailed analysis (pas out Figure 6). The 
task documented on this :nplt is ''Select a Detail U^ng a Duty Roster.** The cues which initiate 
task performance are first listed in block 7 on the form. You will notice that etch cue is aasociated 
with a response consiiting of executbn of one of the elements of task performance. Most frequently, 
all cues are associated with the first element of performance, but this is not always the caae. Some 
cues, for example, may complicate the situation and ^ut:e extra steps or drcisions prior to perform- 
ance of the ''main stream** elements, other cues may ref alt in by-pus of earlier steps in the process. 
One of the major advantages of this^form is its flexibuity in showing thu type of relationship among 
the cues. 
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TASK STRUC.TURE<ANALYSIS 


t. DAT! 

I JUL 197.5 


I. PAOI 

A 


I . 



MOS: VARIABLE 



4 DUTY} 



%, TASK STATIMINTt (STATE AS AN ACTION VCKl WITH AN OBJECT:) 

Sdscc X Detail Using A Duty Roster (DA Form 6) 


TASK NUMilK 


7. CUt*s (LIST EVENTS WH»CM INITIATE TASK ^HFOHMANCE.) 

f 






OO TO 


NICISSAHY 


!• Oral or written requirement to sfelect a recurring detail. 


1 


1, Date & Type 
of Detail, 


2, Recurring re^^uivement for a detail" (SOP), 






1 




3, Change in status of anyone on duty roster after publica- 
tion of detail roster. 


30 


Notification of 
Change in Status, 


OEClSlONi AND/C YCPSs 

fSTATt DECISION AS VES/fsiO QUESTIONS 1 


OICISIONS 






(STATE STE^ ASSUBTASKS.) 


VIS 


NO 






1, Do you have a duty roster for this detail? 


' 2 


25 


X 


All Active Duty 
Rosters, 


2. Secure Duty Roster, 

• 


X 


X 


J 


Appropriate Duty 
Roster, in Files 
in Office, 


3, Are all columns of the roster already u.*'.d* 


25 




X 




A, Annotate date of detail to next open column. 


X 


X 


5 




5, Are there any personnel to be added to the 
roster? 


23 


6 


X 


^tes IndlGatii\g« 
Required Additions 


a, Np.w arrivals (ASGD or ATCHD), 








"Notification of 
Release from EQ, 


b. Permanent release from ED, - 






»« 




6, Are there any personnel to be deleted from 
the roster? 


24 


7 


X 


^otes Indicating 
Required Del«ttions 


a. Departures (reassignment or Rel from 
ATCHD) , 








Notification of 
New ED, 


b. New permanent ED, 

7, Any authorized non-availables? 
(LV\ PASS, SD, TDY, SICK-LINE of Duty), 




9 


t 

X 


\ 

kiies^ Indicating 
Status of Individ- 
lals. 


8, Post "A" opposite name under date of detail. 


X 


X 


9 





AOMINCEN FORM 1 JUL 75 

(ATSG TE) 



^R^VIOUS EDITIONS MAY BE USED. 
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TASK STRUCTURE ANALYSIS * 

— ^ , . ^ , 


rAoi 2 or 


DtCISIOHB 


QO TO 


NKCillAHV 




4 FAatt 


VM 


NO 


STtr 


CONDITIOMf 




Any u:>authorlzcd non-«v«llablcs? 
ULU, Conflfttaent, Arrest, other reason 

misconduct). 


(Am, SICK- 
due to ovn 


■ 10 


11 


X 


Notes Iniilcatlns 
otacus of 
Individuals. 




10. Pdst "U". opposite name under date 


of detail. 


X 


X 


11 






11. Any ellglbles who cannot be selected diie to 
previous detail or other duty? 

J 


12 


13 


X 


Other Deatall 
Roatera, Knowl- 
ca^c or ucner 
Duty Requlremehta 




12. Post "D" opposite tiame under date 


Df detail. 


X 


X 


13 




- 


H. ts this a consolidated roster? 




14 


15 


X 


Consolidated or 

Non-conaolidatad 

Roster. 




ocxccb previous column ^it available) per- 
taining to category of detail (weekend/holiday of 
Wi?ekdny) . 


X 


X 


15 






15. Identify (next) highest number in thci "stLjct- 
ca previous column (It available) vlthouC «n A , 
"U" or "D" under date of detail. 


X 


X 


16 






au. IS tnere more c».ari one Soldier yitn the same 
highest nurabe 


17 


19 


X 






17. Does the (remc:iulng) detail requirement equal 
or exceed those identified? 


19 


18 


X 






18. Selecc sufficient individuals to fill detail 
rr^uircment by going dovn from ton of roster. 


X 


X 


1 o 
ly 






19. Place hatched lines, in pencil, opposite 
selected name(s) under date of detail. 


X 


X 


20 


Pencil. 




20. Are more individuals required to fill detail 
^requirement? ^ 


15 


21 


X 






21. With the lixception of thos\e posted' tirith "A", 
add 1 to .previous cciumn running total ind pott 
I'nder date of detail (use red pencil for veekend/. 
holiday columns on consolidated rosters). 


X 




22 


Red Pencil, 
Black Pencil. 




22. file Dijcy Roster and- publish Detail Rostej. 
(separate tasks). 


X 


X 


EOT 


• 


] 


23. Am^otite name to bcttom of roster and line 
3ut previous detail columns, annotate reason on 
reverse aide. 


X 


> 


6 




t 


Delete name from roster and annotate reanoA 
>n reverse side. j 


X 


X 


7 
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TASK STRUCTURE ANALYSIS 


PMW, 3 or 


OICItlOHS 


•OTO 


NSCIMAAV 




vts 


NO 


STir 


CONOITlONt 


2S. Secure blank Duty Roster. 




X 


X 


27 


n 

Blank Duty Ront^i 


26. Fill In nature of dutyi organization, and 
froa date. 


X 


X 


27 




27. Identify all eliglbles for entry on roster. 


A 


X 


28 


Unit RosCtr or 
Previous Duty 
Roster (Filled). 


28. Enter naaes on roster alphabetically by pay 
grade, listing rank (SFC, SP6, SSG, CPL, etc) 


X 


, X 


4 




29^ Post changes to duty roster. 




X 


X 


30 




30. Is there any change in status of selected 
individuals in the detail roster which could pre- 
clude their pulling the detail? 


31 


EOT 


X 


Notification of 
Changa in Status 
of Individuals in 
Published Dstail 

Roster. 


31. Erase hatched lines pertaining to those 
individuals and post new status. 


X 


X 


15 


Eraser. 


PRODUCT CHARACTERISTICS: 












1. List of selected individuals for detail 




* 






a. Proper number. 












b. Correct names. 












2. Properly posted duty roster 












a. Correct date of detail in 
ing. 


column head- 










b. "A" posted by appropriate 


name. 










c. "D" and correct number posted by 
appropriate name. 










d. "U" and correct number posted by 
appropriate name. 

r 

e. Hatched lines by appropriate names. 


















f . Correct numbers, posted by all other 
names. 










g. Correct names added to roster.' 










h. Correct names deleted from 


roster. 
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TASK STRUCTURE ANALYSIS 


PAOK ^ OP 
4 PAOCi 


DICI 

y» 


ilONi 
NO 


ao TO 

iTIP 


NICIiiAHV 

CONDITIONi 


I. Proper nnnotntlonn madr on rvvp.rnt of 

j. Correct heading on new rosters. 

k. Personnel listed alphabetically by 
rank on new rosters. 

1. Red entries for weekend/holiday 
details on consolidated rosters. 

1 






» 
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Once at least one cue has been idenUfied the designer may begjn to list the elem«nU of ptrform- 
ance in block 8. Those of you who are /amiliar with decision flow charts or logic trew will itcogmM 
that this format is nothing more than /. flow chart in.nanative form. Instead of using boxts and 
arrows we used the associated "decision-yet no" and "go-to-step" blocks to establish the rtUtionihip* 
among the elements of performance. Agaii, the format is dtaigntd to maximize flexibility for the 
designer. You may use this form to document a stimulusHresponie Uble, a linear list of lub-taaki, or 
a decision table. In our experience, however, most real world tasks have considenble branching in 
that varying conditions aiid cues affect the manner in which the task is performed. Sorting out the. 
logic ot these interactions is a time consuming process, but one which yieldi considerable insight. 
Seldom is a simple list of subtasks suffkient to detail the complexity of real world talk performance. 
The task Structure Analysis form forces the designer to consider the interreUtionshipi among condi- 
tions,, cues, and elements of performance. Directly next to the listing of elemenU of task performance 
the designer is asked to document the conditions fssociated "with each step or decision. This docu- 
mentation U especially important later in test design. At the end of the Task Structure Analyiii we 
document the characterutics of the desired results of task perfo.rmance. When the task does mult in 
a tangible product we are most interested in a listing of the characteristics of that product. Again, this 
motivated by our needs in test development. Characteristics of the product are especially important 
to %is because our design methodology stresses the use of product meuures whenever poeaible. When 
no tangible product is available, a listing of key steps or known errors in the proceu of tack perform- 
ance may be used. This listing of process steps or errors then becomes the basis for a successful pro- 
cess measure to test competency. 

You are all familiar with the concepts of test ralidity and reliability but the concept of test fidel- 
ity refers to how closely the requirements of the test m»tch the requiremenls of task in the real world. 
The assumption is that the higher the fidelity of test, the higher Uie probability that the test has con- 
tent validity. Many of you may have already recognized that the Task Structure Analysis repreeenU 
tiie highest fidelity test which could be used to measure competency. If an examinee were presented 
with all pwisible cues and conditions, performed all steps and decisions, and produced a product with 
all of the desired charactcnstics, we could certainly certify his competency. 

With the level oi' detail included in the Task Structure Analysis the instructional designer has a 
firm foundation for the design of both the ptrformance test and the instruction itself. Some ap- 
proaches to instructional systems design indicate that the test and the training should be deisgned, 
simuluneously but separately, direct from the task analyas. V/hile we do not object to this philos- 
ophy, our limited resources normally require that the same instructor perform both functions. Ac- 
cordmgly we advocate design of the performance test, prior to and independent of, the design of the 
instructional package. 

Our approach to test design is relatively straight forward. The first step is to identify the environ- 
ment m which the test will be conducted. Tests may be conducted in a claisroom, in a laboratory or 
other simulated job environment, in an vtual job setting, or ak part of a conespondence course. Each 
of these environments present a different set of constraints which must be addressed in the design of 
the msiruments. Once the en\ironment.has been established the designer closely examines each cue 
and condition associated with the process as shown on the Task Structure Analysis. 

This examination results in a listing of the real world constraints which preclude full fidelity test- 
mg of the task. The test designer then attempts to develop a simulation for each clue of condition 
precluded by the testing constraint. If realistic and cost effective simulations cannot be designed the 
elements of performance associated with those cues or conditions are merely eliminated from the test 
As a result of this process a modification of the original detailed analysis emerges which represents Uie 
highest level of fidelity at which Uie task could be tested. It is at this point, and no earlier, that the 
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constxaints which all test designers consider, come into play. Set up time, lime to administer, and 
time to score and grade are of primary concern to all instructors since they represent time and effort 
of both the instructor and the student. Consideration of these three additional constraints may agtin 
require further reduction in the level of fidelity of the performance test. In the end, however, the 
final design should represent the highest fidelity test which can be designed within existing coat con- 
straints. 

It should be noted that tc this point I have not mentioned the Student Centered Performance ob- 
jective often refeijed to as the instructional objective. Although many writers advocate the writing of 
the instructional objectives direct from task analysis, we take the position that the instructional objec- 
tive is nothing more than a description of the performance test which the student must pass in order 
to demonstrate competency. Accordingly, we advocate preparation of that objective immediately fol- 
lowing the design and valklation of the performance test instrument. At this stage, the conditions, 
actions, and standards are known a^d the instructional objective can be written to cleariy ouUict for 
the student exactly what is expected of him. The pos^ bility of a disconnect between the objectivt 
and test is also avoided. 

Our approach to instructional design, although not fully developed at this point in time, also en- 
visions the Task Structure Analysis as tht foundation document By exaAiining each element of per- 
formance listed in the analysis and asking the question ''What must the student know, or be able to 
do, to perform this step or make this decision,** the designer can, with relative ease, prepare a listing 
of skills and knowledges inherent in the task. An analysis of the target student population and ttit 
prerequiiutes courses and blocks of instruction can then be made to determine which of these skills 
and knowledges are already within the repetoire of the prospective student. Once these h.we been 
eliminated, the remainder represent the content of the instructional package to be designed; If wo are 
to utilize a functional context approach to instructional design, the sequence of instruction is dictated 
by the sequence outlined in the Task Structure Analysis with knowled; nd skills taught as they 
become necessary to accomplish each element of performance. Our a^ -uach to the selection cl 
methods and media is simply to utilize the cheapest approach which accomplishes the instructional 
objective as measured by validation of the instructional package or lesson using the performance test 
designed earlier as the criterion. 

In summary we have found that cost effective instructional design required task specification at 
two different and distinct levels of detail. First short terse task statements written at a level of specif- 
ity which facilitates not only data^ collection and task selection, but which also facilitate further de* 
tailed analsysis. Second, the detailed analysis of selected tasks into cues, conditions, elements and 
results of performance to facilitate performance test and instructional de^gn. 

The enormity of the front end analysis effort required to provide a firm basis for the design of 
vocational education or job training courses is indeed staggering but, professionals, we must face the 
issue directly if we are ever to maintain that we are following the precepts of educational account- 
ability. 
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Summary of Symposium Evaluation 

Willie H. Thomas 
The Center for Vocational Education 

In an effort to become aware of the opinions participants had relative to the Symposium on 
Task Analyses/ Inventories, the one-hundred and fifty-eight (158) participants were asked to evalu- 
ate the symposium by responding objectively and/or subjectively to several questions concerning: 
(1) the benefits they iicquired as a result of attending the symposium; (2) suggestions for future 
programming of symposiums. 

Eighty-three (53 percent) of the 153 participants responded to the evaluation survey. The 
results of .in analysis of those responses are summarized below. 

Primary Objectives for Attending Symposium 

The following is a condensed listit.g of the participants objectives for attending the symposium. 
The participants objectives reflected the many aivetse backgrounds (i.e., business, industry, universi- 
ties, public and private organizations and labor) they represented. The primary objectives were: (1) 
to become knowledgeable of specific methodologies and evaluation techniques; (2) t'> learn about 
the identification and developir.ent of curriculum and performance-based objectives for teaching and 
training purposes, (3) to seci re an overview of the state-of-the-art; (4) to gain expertise in developing, 
compiling, and interpreting .ask analysis data; and (5) to determine how to utilize task analyses/ 
inventories to accomplish various training goals and objective.s. 

Rating of Achievement of Objectives 



N = 83 



Well 
Achieved 


Modeiately 
Achieved 


Mostly 
Achieved 


Not 
Achieved 


No 
Response 


22 


30 


18 


6 


7 


26.5% 


36.1% 


21.7% 


7.2% 


8.4% 
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Sugges tio ns for Future Symposium Topii s 

The fullowinj; cundensutl btatcmcnl Indicate parlicipanU* upiniuns as tu what future symposium 
^.opics un Task Analv^eb. Inventuricb shuiuil cumpribc. The tupitb that appeared must frequently were. 
(1) how to ust task anaUscb. Invunturies lot currituluni and instructional content development; (2) the 
praiticcd application uf tabk analjscb (i.e.. how la utili/.e the information efficiently and effectively for 
those job categories for which anal\seb h.ive bc^ii duveluped, (3) *'sho\v cUid tell" to reflect uses of task 
analysob in job performance, evaluatlv^n, and { 4) bpl-cificb on huw'to derive job data, how to use various 
data ^alherini: techniques, and how to belccL de\ibe liUjk iiniil>sib methodology considering general par- 
ameters such asseleclion criteria. 

S uggestions for Changes in Physical Facilites, Travel Arrangementi.. Meals, Lodgings , 
Length of SymposiunK Schedules and Speakers 

Participants reactiotis with respect tu ph.Vbical facilities, travel, arrangements, meals, and lodging 
evidenced ver\ few cumplainb. Ilowev«:r, there are twu areas, in particular, that most of the partici- 
pants were dissatisfied with, il i inadequ,»te audiovibUa! equipment and insufficient material provided 
b\ speakers, and (2) the number of speakers programmed for the scheduled days/ time allowed for the 
symposium. 

Comments as Constructive Criticism of Symposium 

The ftillowing participanLs c^mnien 6 should be considered inclusu? -'r.d.or in keeping with all 
the opinions given b> each individual, bu reflect the neneral opinions held by participant^i (1) due to 
the diversity of gtoup int-resl., in service training sessions anJ v. orkbhops should be cond icted with 
homogeneoub groups (i.v w' Ji educators, bubines^, indubtrj , management and personi.sl directors) 
for better u.idtrstanding of how each inU rebt group could utilise task analyses/inventories for the 
most signifii ant to their work. (2) include more informatior on name, tags, such as, the organization, 
institution 'jr agencv being represented, to adovv fur coii;mon mtt*r;,;>t mixing and the enhancement of 
more gruup ind iplerpersonal interactiun,and (3) future .\vmposiumb should be divided inio IslcuUsi^, 
tinct groups (i.e., divide the group into those individuals intercbted in job analysis and those who are 
more interested in content analvsi.s.) 



General Rating of Symposium 

N - 83 



Excellent 


(Jood 


Fair 


Poor 


No Response 


Total 


la 


43 


13 


5 


4 


83 


2n 


51.8'; 


15'; 


6'7 


4.5'; 

■t 
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^ UK £oniU\enti J>'jui TIE «md its ptoTduets and services^ please call or 



Tadi Inventory Exchanf,c (TIE) 

Ihe CeutCtftor Vocational Education 

ISSO Kenny Road 

Columbus, Ohio 43210 

Phon.^: mA\ 486-5655, Ext 357 



u:r A t^ddy io help you in whatever way it can. 

Paul Schrocder — Project Director ' 

Sunita Sildanha Secretary 

Willie Thomas — Graduate ilesearch A«;soci;fite 

Ernie \V:^lIerstein ^ Studfnt Assistant 



